-- Logs begin at Wed 2022-08-10 22:00:06 UTC, end at Wed 2022-08-10 23:39:45 UTC. -- Aug 10 23:04:36.215226 dv-cinder-851449-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 23:04:36.222621 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 23:04:36 2022] *** Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: nodename: dv-cinder-851449-5-iscsi Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: machine: x86_64 Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: clock source: unix Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: pcre jit disabled Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: detected number of CPU cores: 4 Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: current working directory: / Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: detected binary path: /usr/bin/uwsgi-core Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: your processes number limit is 47680 Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: your memory page size is 4096 bytes Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: detected max file descriptor number: 2048 Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: lock engine: pthread robust mutexes Aug 10 23:04:36.225977 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: thunder lock: enabled Aug 10 23:04:36.231587 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 23:04:36.231587 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 23:04:36.266364 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: Python main interpreter initialized at 0x559b5efb39c0 Aug 10 23:04:36.266364 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: python threads support enabled Aug 10 23:04:36.266364 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: your server socket listen backlog is limited to 100 connections Aug 10 23:04:36.266364 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: your mercy for graceful operations on workers is 90 seconds Aug 10 23:04:36.266826 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 23:04:36.266826 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: *** Operational MODE: preforking *** Aug 10 23:04:36.267075 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: *** uWSGI is running in multiple interpreter mode *** Aug 10 23:04:36.267075 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: spawned uWSGI master process (pid: 106227) Aug 10 23:04:36.267287 dv-cinder-851449-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 23:04:36.271708 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: spawned uWSGI worker 1 (pid: 106228, cores: 1) Aug 10 23:04:36.271708 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: spawned uWSGI worker 2 (pid: 106229, cores: 1) Aug 10 23:04:36.271708 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 23:04:36.927790 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 23:04:36.931595 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 23:04:38.037351 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 23:04:38.037351 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: from cryptography.utils import int_from_bytes Aug 10 23:04:38.037956 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 23:04:38.037956 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: from cryptography.utils import int_from_bytes Aug 10 23:04:38.041366 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 23:04:38.041366 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: from cryptography.utils import int_from_bytes Aug 10 23:04:38.041842 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 23:04:38.041842 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: from cryptography.utils import int_from_bytes Aug 10 23:04:40.541166 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 23:04:40.541726 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 23:04:40.541878 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 23:04:40.542247 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 23:04:40.542337 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 23:04:40.542419 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 23:04:40.542513 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 23:04:40.542674 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 23:04:40.542927 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.543052 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 23:04:40.543252 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.543342 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 23:04:40.543570 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.543680 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.543885 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.543983 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.544214 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.544316 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.544517 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.544610 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.544834 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.544931 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.545146 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.545244 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.545467 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.545559 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.545723 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.545853 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.546039 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.546186 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.546352 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-5-iscsi {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.546444 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.546680 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.546773 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.546997 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.547099 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-5-iscsi {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.547303 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.547403 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.547614 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.547760 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.547903 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.548032 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.548221 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.548363 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.548524 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.548658 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.548915 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.549053 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.549471 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.549593 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.549701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.549836 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.550012 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.550128 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.550318 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.550500 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.550727 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.550932 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.551114 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.551308 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.551507 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.551687 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.551892 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.552081 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.552276 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.552472 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.552652 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.552862 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.552862 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.553194 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-5-iscsi {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.553378 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.553599 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.553599 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.553966 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-5-iscsi {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.554154 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.554345 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.554345 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.554724 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.554921 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.555153 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.555153 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.555445 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.555595 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.555792 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.555962 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.556122 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.556252 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.556378 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.556510 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.556668 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.556797 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.556936 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.557075 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.557203 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.557406 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.557543 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.557678 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.557889 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.558044 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.558174 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.558299 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.558424 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.558550 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.558713 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.558855 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.558990 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.559120 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.559247 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.559382 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.559509 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.559636 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.559762 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.559887 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.560019 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.560156 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.560285 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.560411 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.560541 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.560723 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.560869 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.560997 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.561125 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.561258 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.561385 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.561512 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.561649 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.561784 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.561912 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.562044 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.562172 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.562309 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.562443 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.562571 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.562752 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.562893 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.563021 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.563157 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.563285 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.563418 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.563553 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.563681 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.563806 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.563941 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.564068 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.564194 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.564319 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.564445 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.564570 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.564705 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.564839 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.564966 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.565092 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.565217 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.565355 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.565484 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.565610 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.565847 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.565994 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.566131 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.566276 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.566404 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.566532 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.566732 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.566866 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.567051 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.567196 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.567370 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.567582 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.567713 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.567847 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.567982 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.568121 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.568249 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.568375 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.568558 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.568700 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.568888 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.569031 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.569190 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.569334 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.569463 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.569591 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.569730 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.569867 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.570001 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.570129 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.570308 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.570446 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.570611 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.570779 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.570922 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.571058 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.571229 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.571372 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.571519 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.571649 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.571818 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.571950 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.572121 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.572265 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.572436 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.572574 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.572747 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.572880 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.573058 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.573202 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.573367 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.573509 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.573676 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.573816 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.574023 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.574161 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.574277 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.574401 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.574573 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.574724 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.574905 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.575050 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.575217 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.575354 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.575520 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.575660 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.575825 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.576046 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.576186 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.576313 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.576435 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.576581 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.576709 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.576851 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.577013 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.577143 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.577321 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.577463 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.577613 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.577819 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.577963 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.578099 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.578227 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.578361 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.578488 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.578627 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.578818 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.578947 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.579122 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.579296 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.579435 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.579551 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.579752 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.579884 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.580588 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.580725 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.580919 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.581052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.581242 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.581373 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.581553 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.581684 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.581864 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.581996 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.582164 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.582296 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.582469 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.582601 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.582794 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.582935 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.583101 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.583239 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.583396 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.583525 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.583729 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.583859 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.583995 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.584123 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.584300 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.584446 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.584601 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.584738 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.584904 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.585035 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.585213 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.585352 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.585528 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.585659 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.585851 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:04:40.585982 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.586196 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.586372 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.586502 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.586635 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.586833 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.586965 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.587167 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.587305 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.587488 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.587618 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.587847 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.587996 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.588138 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.588255 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.588425 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.588557 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.588738 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.588876 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.589049 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.589182 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.589360 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.589491 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.589677 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.589820 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.589991 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.590121 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.590314 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.590465 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.590628 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.590817 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.590962 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.591103 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.591272 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.591405 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.591584 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.591716 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.591901 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.592033 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.592216 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.592347 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.592533 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.592672 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.592846 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.592978 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.593173 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.593303 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.593489 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.593630 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.593812 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.593942 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.594136 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.594280 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.594454 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.594594 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.594788 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.594922 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.595099 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.595239 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.595405 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.595551 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.595748 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.595918 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.596626 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.596757 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.597036 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.597493 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.597835 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.598042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.598173 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.598472 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.598817 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.599139 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.599271 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.599458 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.599589 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.599777 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.599917 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.600095 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.600227 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.600437 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.600568 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.600756 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.600903 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.601076 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.601207 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.601394 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.601525 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.601705 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.601836 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.602019 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.602159 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.602329 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.602467 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.602642 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.602801 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.602972 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.603102 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.603275 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.603404 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.603582 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.603720 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.603884 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.604014 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.604191 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.604323 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.604500 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.604630 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.604819 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.604951 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.605132 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.605262 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.605436 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.605567 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.605766 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.605903 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.606069 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.606209 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.606380 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.606513 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.606780 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.606914 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.607053 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.607195 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.607323 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.607451 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.607599 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.607731 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.607910 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.608135 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.608340 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.608473 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.608600 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.608727 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.608853 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.608989 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.609123 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.609252 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.609425 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.609558 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.609730 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.609863 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.610036 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.610177 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.610350 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.610481 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.610676 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.610809 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.610994 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.611420 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.611632 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.611798 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.611948 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.612078 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.612205 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.612339 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.612477 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.612616 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.612788 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.612929 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.613118 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.613251 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.613445 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.613590 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.613751 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.613882 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.614075 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.614214 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.614404 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.614550 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.614753 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.614885 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.615058 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.615187 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.615367 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.615515 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.615651 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.615794 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.615957 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.616099 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.616257 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.616401 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.616563 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.616696 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.616909 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.617047 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.617184 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.617359 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.617489 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.617614 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.617739 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.617865 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.618022 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.618154 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.618379 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.618530 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.618712 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.618844 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.618992 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.619203 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.619339 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.619467 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.619593 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.619727 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.619865 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.619996 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.620135 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.620263 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.620464 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.620613 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.620797 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.620936 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.621115 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.621247 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.621437 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.621583 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.621748 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.621881 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.622062 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.622194 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.622371 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.622511 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.622699 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.622833 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.623012 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.623155 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.623321 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.623467 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.623636 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.623874 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.624005 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.624187 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.624327 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.624511 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.624650 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.624819 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.624951 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.625141 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.625281 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.625448 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.625578 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.625764 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.625893 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.626064 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.626206 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.626376 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.626512 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.626736 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.626871 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.627094 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.627244 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.627397 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.627537 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.627712 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.627849 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.628017 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.628166 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.628327 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.628472 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.628667 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.628796 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.628933 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.629062 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.629218 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.629350 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.629524 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.629657 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.629839 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.629973 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.630146 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.630292 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.630459 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.630591 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.630790 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.630930 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.631107 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.631245 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.631412 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.631544 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.631724 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.631855 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.632024 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.632156 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.632336 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.632476 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.632659 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.632797 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.632971 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.633102 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.633282 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.633421 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.633591 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.633721 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.633904 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.634048 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.634215 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.634358 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.634519 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.634713 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.634846 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.634972 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.635139 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.635288 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.635442 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.635574 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.635749 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.635887 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.636059 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.636191 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.636364 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.636495 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.636669 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.636807 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.637015 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.637236 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.637369 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.637495 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.637621 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.637747 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.637889 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.638024 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.638152 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.638279 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.638427 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.638559 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.638798 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.638937 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.639072 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.639201 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.639380 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.639513 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.639699 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.639830 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.639997 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.640127 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.640298 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.640439 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.640619 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.640756 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.640926 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.641056 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.641228 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.641369 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.641530 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.641662 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.641831 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.641964 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.642162 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.642305 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.642466 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.643211 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.643347 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.643488 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.643618 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.643755 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.643932 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.644066 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.644242 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.644382 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.644553 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.644694 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.644859 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.644991 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.645167 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.645307 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.645478 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.645618 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.645785 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.645916 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.646090 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.646223 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.646399 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.646531 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.646732 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.646865 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.647040 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.647170 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.647393 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.647533 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.647662 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.647797 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.647951 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.648096 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.648257 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.648388 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.648561 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.648691 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.648909 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.649057 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.649186 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.649438 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.649570 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.649781 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.650012 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.650154 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.650342 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.650474 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.650693 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.650840 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.650994 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.651139 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.651310 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.651452 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.651819 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.651971 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.652111 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.652247 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.652410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.652544 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.652725 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.652858 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.653036 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.653178 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.653342 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.653489 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.653649 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.653781 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.653953 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.654086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.654261 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.654406 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.654561 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.654716 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.654892 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.655025 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.655196 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.655330 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.655501 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.655633 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.655800 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.655930 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.656103 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.656237 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.656404 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.656544 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.656705 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.656837 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.657014 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.657147 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.657315 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.657525 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.657663 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.657790 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.657925 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.658061 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.658269 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.658970 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.659184 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.659325 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.659454 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.659581 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.659753 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.659888 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.660061 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.660203 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.660400 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.660531 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.660718 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.660849 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.661053 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.661196 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.661360 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.661490 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.661668 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.661801 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.662009 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.662138 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.662264 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.662400 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.662582 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.662731 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.662913 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.663045 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.663217 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.663349 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.663517 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.663649 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.663821 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.663952 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.664124 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.664254 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.664423 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.664554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.664729 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.664862 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.665035 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.665167 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.665337 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.665476 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.665640 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.665777 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.665938 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.666072 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.666243 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.666385 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.666541 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.666713 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.666856 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.666991 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.667157 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.667303 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.667454 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.667664 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.667796 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.667931 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.668059 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.668197 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.668326 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.668454 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.668615 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.668754 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.668920 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.669053 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.669261 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.669408 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.669541 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.669669 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.669806 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.669935 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.670095 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.670228 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.670394 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.670525 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.670721 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.670854 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.671025 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.671156 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.671323 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.671455 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.671639 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.671777 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.671941 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.672080 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.672241 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.672375 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.672540 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.672673 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.672844 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.672975 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.673138 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.673279 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.673442 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.673574 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.673749 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.673901 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.674087 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.674231 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.674397 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.674529 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.674719 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.674854 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.675072 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.675223 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.675352 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.675485 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.675623 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.675753 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.675890 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.676019 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.676191 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.676323 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.676489 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.676634 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.676776 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.676906 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.677071 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.677203 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.677370 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.677512 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.677673 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.677868 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.677998 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.678125 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.678251 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.678386 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.678552 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.678715 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.678879 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.679013 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.679183 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.679339 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.679532 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.679664 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.679792 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.680064 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.680196 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.680339 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.680468 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.680595 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.680729 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.680859 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.681034 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.681176 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.681343 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.681476 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.681649 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.681782 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.681956 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.682094 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.682258 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.682390 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.682566 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.682754 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.682885 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.683024 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.683185 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.683325 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.683484 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.683614 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.683785 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.683919 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.684100 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.684239 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.684407 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.684530 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.684712 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.684846 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.685029 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.685153 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.685333 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.685463 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.685650 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.685783 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.686055 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.686208 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.686344 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.686478 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.686616 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.686782 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.686919 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.687056 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.687184 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.687326 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.687498 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.687624 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.687812 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.687993 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.688124 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.688260 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.688422 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.688554 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.688728 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.688869 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.689033 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.689175 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.689336 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.689488 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.689700 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.689831 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.689958 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.690239 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.690381 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.690511 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.690644 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.690831 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.690980 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.691109 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.691238 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.691364 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.691491 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.691618 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.691762 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.691891 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.692018 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.692276 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.692410 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.692592 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.692737 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.692906 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.693046 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.693214 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.693347 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.693528 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.693668 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.693841 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.693972 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.694158 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.694289 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.694475 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.694609 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.694806 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.694948 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.695110 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.695234 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.695524 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.695657 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.695832 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.695971 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.696140 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.696272 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.696447 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.696578 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.696747 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.696876 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.697046 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.697187 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.697352 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.697486 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.697664 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.697794 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.697962 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.698101 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.698261 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.698401 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.698554 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.698754 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.698885 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.699031 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.699182 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.699315 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.699500 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.699633 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.699912 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.700062 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.700273 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.700403 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.700530 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.700663 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.700906 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.701049 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.701215 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.701357 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.701537 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.701667 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.701866 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.701998 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.702220 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.702409 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.702540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.702762 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.702930 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.703069 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.703208 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.703363 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.703503 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.703670 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.703811 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.703992 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.704133 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.704313 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.704452 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.704619 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.704751 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.704931 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.705587 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.705754 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.705887 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.706076 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.706209 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.706395 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.706537 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.706717 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.706876 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.707023 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.707204 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.707434 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.707569 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.707753 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.707886 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.708059 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.708191 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.708374 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.708509 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.708696 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.708836 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.708997 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.709132 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.709297 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.709438 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.709605 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.709738 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.709954 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.710094 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.710251 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.710444 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.710575 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.710733 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.710864 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.711002 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.711163 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.711297 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.711471 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.711619 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.711775 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.711917 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.712077 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.712211 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.712378 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.712510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.712702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.712843 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.713003 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.713136 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.713324 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.713459 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.713634 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.713776 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.713940 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.714072 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.714256 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.714387 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.714557 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.714746 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.714890 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.715018 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.715180 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.715312 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.715483 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.715615 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.715786 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.715918 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.716086 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.716219 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.716425 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.716560 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.716725 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.716859 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.717043 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.717175 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.717402 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.717541 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.717691 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.717822 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.717998 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.718145 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.718325 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.718456 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.718644 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.718796 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.718983 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.719127 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.719291 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.719430 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.719599 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.719733 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.719900 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.720053 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.720308 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.720456 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.720647 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.721320 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.721320 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.721578 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.721710 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.721845 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.721974 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.722103 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.722240 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.722370 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.722513 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.722645 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.722864 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.722997 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.723174 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.723309 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.723500 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.723632 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.723799 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.723934 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.724106 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.724246 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.724414 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.724555 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.724713 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.724846 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.725016 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.725150 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.725318 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.725459 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.725656 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.725798 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.725956 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.726088 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.726281 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.726413 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.726672 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.727455 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.728769 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.731207 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.731375 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.731514 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.731647 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.731789 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.731929 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.731929 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.732185 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.732314 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.732443 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.732582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.732712 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.732840 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.732956 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.733089 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.733089 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.733343 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.733472 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.733599 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.733726 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.733854 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.734040 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.734179 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.734310 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.734445 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.734581 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.734724 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.734869 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.735000 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.735128 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.735256 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.735384 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.735511 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.735651 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.735781 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.735910 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.736037 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.736465 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.736611 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.736741 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.736869 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.736998 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.737126 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.737263 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.737403 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.737533 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.737661 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.737789 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.737924 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.738066 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.738202 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.738342 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.738473 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.738602 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.738790 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.738933 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.739064 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.739200 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.739337 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.739468 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.739614 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.739747 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.739878 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.740013 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.740142 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.740278 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.740481 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.740614 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.740743 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.740859 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.740992 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.741209 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.741209 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.741475 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.741606 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.741734 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.741869 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.742012 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.742149 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.742279 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.742408 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.742536 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.742681 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.742832 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.742963 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.743091 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.743257 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.743395 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.743532 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.743675 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.743805 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.743932 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.744068 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.744197 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.744338 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.744469 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.744605 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.744744 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.744744 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.744994 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.744994 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.745253 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.745381 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.745508 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.745635 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.745765 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.745905 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.746035 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.746170 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.746306 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.746441 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.746579 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.746803 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.746937 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.747065 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.747193 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.747328 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.747466 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.747597 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.747724 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.747852 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.747984 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.748113 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.748254 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.748384 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.748511 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.748639 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.748756 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.748885 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.749022 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.749151 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.749278 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.749406 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.749540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.749540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.749790 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.749790 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.750021 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.750149 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.750276 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.750417 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.750546 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.750694 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.750824 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.750964 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.751094 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.751245 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.751441 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.751573 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.751709 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.751838 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.751996 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.752138 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.752268 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.752396 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.752523 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.752650 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.752777 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.752914 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.753042 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.753178 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.753307 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.753441 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.753583 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.753712 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.753839 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.753966 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.754094 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.754222 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.754358 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.754487 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.754615 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.754762 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.754890 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.755017 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.755161 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.755293 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.755420 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.755555 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.755714 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.755848 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.756023 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.756157 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.756344 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.756477 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.756654 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.756797 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.756962 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.757103 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.757269 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.757407 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.757570 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.757713 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.757877 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.758017 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.758179 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.758311 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.758488 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.758629 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.758814 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.758947 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.759123 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.759255 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.759427 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.759572 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.759739 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.759879 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.760037 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.760176 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.760363 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.760496 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.760672 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.760803 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.760978 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.761108 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.761298 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.761448 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.761645 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.761777 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.761904 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.762031 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.762232 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.762367 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.762543 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.762727 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.762915 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.763097 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.763241 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.763432 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.763752 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.763883 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.764095 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.764238 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.764426 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.764566 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.764768 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.764900 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.765106 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.765246 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.765411 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.765543 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.765721 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.765859 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.766029 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.766170 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.766338 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.766470 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.766644 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.766801 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.766976 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.767110 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.767286 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.767419 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.768113 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.768250 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.768426 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.768561 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.768734 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.768867 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.769039 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.769175 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.769346 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.769480 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.769653 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.769787 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.769961 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.770108 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.770268 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.770402 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.770574 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.770726 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.770908 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.771056 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.771222 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.771353 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.771541 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.771697 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.771891 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.772033 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.772162 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.772290 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.772460 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.772601 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.772767 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.772914 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.773073 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.773206 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.773378 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.773512 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.773684 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.773826 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.773997 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.774131 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.774311 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.774442 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.774644 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.774800 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.774949 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.775082 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.775279 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.775410 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.775587 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.775729 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.775960 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.776092 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.776278 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.776420 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.776585 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.776718 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.776905 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.777042 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.777224 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.777368 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.777532 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.777671 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.777847 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.777980 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.778154 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.778301 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.778477 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.778608 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.778810 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.778940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.779133 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.779267 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.779453 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.779583 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.779789 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.779992 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.780133 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.780298 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.780418 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.780601 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.780733 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.780907 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.781048 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.781221 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.781353 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.781527 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.781659 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.781827 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.782047 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.782188 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.782318 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.782446 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.782581 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.782742 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.782874 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.783031 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.783178 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.783866 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.784002 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.784171 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.784305 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.784478 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.784620 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.784776 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.784915 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.785078 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.785212 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.785379 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.785512 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.785679 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.785825 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.785977 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.786110 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.786277 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.786409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.786581 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.786745 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.786905 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.787038 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.787206 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.787338 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.787509 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.787650 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.787810 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.787952 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.788110 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.788243 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.788414 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.788556 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.788747 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.788890 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.789055 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.789186 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.789373 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.789506 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.789678 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.789811 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.789995 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.790127 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.790301 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.790435 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.790618 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.790790 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.790958 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.791089 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.791268 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.791394 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.791574 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.791707 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.791884 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.792031 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.792236 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.792368 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.792496 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.792623 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.792791 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.792933 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.793099 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.793231 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.793404 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.793536 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.793709 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.793850 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.794018 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.794151 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.794342 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.794472 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.794644 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.794817 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.794987 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.795121 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.795303 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.795435 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.795618 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.795752 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.795929 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.796060 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.796236 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.796367 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.796551 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.796683 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.796854 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.796985 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.797160 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.797302 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.797466 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.797607 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.797769 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.797901 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.798074 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.798222 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.798384 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.798531 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.798717 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.798870 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.799028 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.799174 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.799341 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.799482 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.799651 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.799791 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.799972 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.800115 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.800296 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.800431 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.800604 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.800744 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.800926 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.801058 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.801246 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.801379 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.801575 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.801718 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.801882 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.802014 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.802269 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.802420 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.802550 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.802739 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.802885 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.803016 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.803167 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.803307 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.803469 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.803602 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.803810 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 23:04:40.803949 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:04:40.804079 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 23:04:40.957026 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO dbcounter [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Registered counter for database nova_api Aug 10 23:04:40.957764 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO dbcounter [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Registered counter for database nova_api Aug 10 23:04:40.977022 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_db.sqlalchemy.engines [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:04:40.980214 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG oslo_db.sqlalchemy.engines [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:04:40.983838 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writer thread running {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:04:40.987569 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writer thread running {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:04:41.039935 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.context [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62cffb2b-b617-4f0b-acb7-5b1c401f61ea(cell1) {{(pid=106229) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 23:04:41.042962 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.context [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62cffb2b-b617-4f0b-acb7-5b1c401f61ea(cell1) {{(pid=106228) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 23:04:41.043890 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:41.044371 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:41.045949 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:41.046714 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:41.046826 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG oslo_concurrency.lockutils [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:41.047174 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:41.047314 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG oslo_concurrency.lockutils [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:41.049207 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:41.050714 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG oslo_concurrency.lockutils [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:41.051338 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO dbcounter [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Registered counter for database nova_cell0 Aug 10 23:04:41.051499 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG oslo_concurrency.lockutils [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:41.051947 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG oslo_concurrency.lockutils [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:41.053952 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG oslo_concurrency.lockutils [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:41.056003 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO dbcounter [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Registered counter for database nova_cell0 Aug 10 23:04:41.056924 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO dbcounter [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Registered counter for database nova_cell1 Aug 10 23:04:41.061444 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO dbcounter [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Registered counter for database nova_cell1 Aug 10 23:04:41.066976 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_db.sqlalchemy.engines [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:04:41.068716 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_db.sqlalchemy.engines [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:04:41.071337 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG oslo_db.sqlalchemy.engines [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:04:41.072745 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writer thread running {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:04:41.073021 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG oslo_db.sqlalchemy.engines [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:04:41.078171 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writer thread running {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:04:41.209539 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writer thread running {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:04:41.214113 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writer thread running {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:04:41.219601 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO dbcounter [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Registered counter for database nova_cell0 Aug 10 23:04:41.224114 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO dbcounter [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Registered counter for database nova_cell0 Aug 10 23:04:41.226914 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_db.sqlalchemy.engines [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:04:41.230862 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG oslo_db.sqlalchemy.engines [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:04:41.231405 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writer thread running {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:04:41.235248 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writer thread running {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:04:41.649074 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: WARNING keystonemiddleware.auth_token [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 23:04:41.656523 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: WARNING keystonemiddleware.auth_token [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 23:04:41.709199 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: WARNING keystonemiddleware.auth_token [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 23:04:41.716527 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: WARNING keystonemiddleware.auth_token [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 23:04:41.996804 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: WARNING keystonemiddleware.auth_token [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 23:04:42.003749 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: WARNING keystonemiddleware.auth_token [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 23:04:42.009334 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b5efb39c0 pid: 106229 (default app) Aug 10 23:04:42.011619 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:42.012979 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002068 Aug 10 23:04:42.013385 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Wed Aug 10 23:04:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:42.069363 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: WARNING keystonemiddleware.auth_token [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 23:04:42.075387 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: WARNING keystonemiddleware.auth_token [None req-c9059351-ff55-4c53-9dd9-5e1f2acfbb37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 23:04:42.080670 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b5efb39c0 pid: 106228 (default app) Aug 10 23:06:02.545877 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:02.547270 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002467 Aug 10 23:06:02.547922 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:02.560300 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writing DB stats nova_api:SELECT=3 {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:02.561961 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writing DB stats nova_cell0:SELECT=3 {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:02.562924 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writing DB stats nova_cell1:SELECT=3 {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:02.564217 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:03.554129 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-5d4581ac-38f1-46d0-81f5-5f7cf1a6361e admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:03.554129 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-5d4581ac-38f1-46d0-81f5-5f7cf1a6361e admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.956452 Aug 10 23:06:03.554129 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1292 bytes} [Wed Aug 10 23:06:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:05.735620 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:05.736801 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-583f44e7-3ace-4124-877d-d3ebc80c749a None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Aug 10 23:06:05.738576 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:06.204218 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-d4c90f9d-dde8-43e0-8b68-a33d31078562 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:06.225265 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:06:06.225265 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: warnings.warn(msg) Aug 10 23:06:06.332894 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-d4c90f9d-dde8-43e0-8b68-a33d31078562 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.588721 Aug 10 23:06:06.333842 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 10 23:06:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:06:06.348075 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writing DB stats nova_api:SELECT=3 {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:06.349314 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writing DB stats nova_cell1:SELECT=3 {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:06.350297 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writing DB stats nova_cell0:SELECT=3 {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:06.351239 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:06.563566 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-c715b57b-5c7a-43f9-a3c0-98ca6f21b079 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:06.567957 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:06:06.567957 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: warnings.warn(msg) Aug 10 23:06:06.711611 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-c715b57b-5c7a-43f9-a3c0-98ca6f21b079 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.369397 Aug 10 23:06:06.712545 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1336 bytes} [Wed Aug 10 23:06:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:08.923001 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-d4c90f9d-dde8-43e0-8b68-a33d31078562 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:08.924054 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-d4c90f9d-dde8-43e0-8b68-a33d31078562 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Aug 10 23:06:08.924491 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:09.609501 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-616af78d-45ff-4295-9cc0-d916bfc8f0f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "disk": 5, "name": "ds512M"}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:09.629223 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:06:09.629223 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: warnings.warn(msg) Aug 10 23:06:09.741256 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-616af78d-45ff-4295-9cc0-d916bfc8f0f5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.810392 Aug 10 23:06:09.742033 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 10 23:06:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:06:09.754121 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-54f6118d-f96e-410b-840e-4bd49c780e11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:09.757316 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:06:09.757316 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: warnings.warn(msg) Aug 10 23:06:09.851735 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-54f6118d-f96e-410b-840e-4bd49c780e11 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101485 Aug 10 23:06:09.852484 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1336 bytes} [Wed Aug 10 23:06:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:12.127278 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-616af78d-45ff-4295-9cc0-d916bfc8f0f5 admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:12.128602 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-616af78d-45ff-4295-9cc0-d916bfc8f0f5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 Aug 10 23:06:12.129373 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:12.530624 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-93c67eb7-46fb-43e4-9be7-4d3aca4ca92c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:12.601891 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-93c67eb7-46fb-43e4-9be7-4d3aca4ca92c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466825 Aug 10 23:06:12.602436 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 10 23:06:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:06:12.614967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-916d23a7-a35f-4c32-ae42-b93e66bdccdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:12.731596 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-916d23a7-a35f-4c32-ae42-b93e66bdccdd admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120305 Aug 10 23:06:12.741692 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1336 bytes} [Wed Aug 10 23:06:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:14.940690 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-93c67eb7-46fb-43e4-9be7-4d3aca4ca92c admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:14.942410 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-93c67eb7-46fb-43e4-9be7-4d3aca4ca92c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002213 Aug 10 23:06:14.943112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:15.393363 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-1b1bf67a-c515-4cc2-b0b1-0806617ce31a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:15.502734 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-1b1bf67a-c515-4cc2-b0b1-0806617ce31a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.543019 Aug 10 23:06:15.502734 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 10 23:06:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:06:15.510823 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-c167bf25-01b6-4291-a4f9-cb59add26367 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:15.589408 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-c167bf25-01b6-4291-a4f9-cb59add26367 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082726 Aug 10 23:06:15.590234 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1336 bytes} [Wed Aug 10 23:06:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:17.776390 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-1b1bf67a-c515-4cc2-b0b1-0806617ce31a admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:17.777384 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-1b1bf67a-c515-4cc2-b0b1-0806617ce31a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 10 23:06:17.777778 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:18.206539 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-9b8c97ca-64a2-4a92-b760-1d9bc061715a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:18.267685 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-9b8c97ca-64a2-4a92-b760-1d9bc061715a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482794 Aug 10 23:06:18.268498 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 10 23:06:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:06:18.281758 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-2b8fc154-26e4-4bec-9e70-a4e49be189d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:18.338133 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-2b8fc154-26e4-4bec-9e70-a4e49be189d2 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060182 Aug 10 23:06:18.339030 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1336 bytes} [Wed Aug 10 23:06:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:20.569333 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-9b8c97ca-64a2-4a92-b760-1d9bc061715a admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:20.570344 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-9b8c97ca-64a2-4a92-b760-1d9bc061715a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 10 23:06:20.570761 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:06:21.038189 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-1eb4943b-8401-4387-8e9b-ae2ec2787301 admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:21.063118 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-1eb4943b-8401-4387-8e9b-ae2ec2787301 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.486007 Aug 10 23:06:21.063657 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1292 bytes} [Wed Aug 10 23:06:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:06:23.723912 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-9b8c97ca-64a2-4a92-b760-1d9bc061715a admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:23.724934 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-9b8c97ca-64a2-4a92-b760-1d9bc061715a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 10 23:06:23.725664 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:24.217735 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-2a4c9509-f138-400b-9bdd-5f4ddb33a84e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "id": "1", "swap": 0}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:24.288648 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-2a4c9509-f138-400b-9bdd-5f4ddb33a84e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.553987 Aug 10 23:06:24.289213 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 10 23:06:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:06:24.303913 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-25ff789c-3001-4b4c-9cfc-e5ca0e8c042d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:24.371664 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-25ff789c-3001-4b4c-9cfc-e5ca0e8c042d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073464 Aug 10 23:06:24.376085 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1333 bytes} [Wed Aug 10 23:06:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:26.589560 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-2a4c9509-f138-400b-9bdd-5f4ddb33a84e admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:26.590712 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-2a4c9509-f138-400b-9bdd-5f4ddb33a84e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 10 23:06:26.591691 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:27.013946 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-70e6ce23-703f-4024-9ffc-e4b91ff582e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:27.104069 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-70e6ce23-703f-4024-9ffc-e4b91ff582e6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506345 Aug 10 23:06:27.104661 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 10 23:06:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:06:27.117561 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-0aa9b45a-8593-46e2-8935-4796fa2176c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:27.348890 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-0aa9b45a-8593-46e2-8935-4796fa2176c5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.234949 Aug 10 23:06:27.349451 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1333 bytes} [Wed Aug 10 23:06:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:29.578153 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-70e6ce23-703f-4024-9ffc-e4b91ff582e6 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:29.579255 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-70e6ce23-703f-4024-9ffc-e4b91ff582e6 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 10 23:06:29.579666 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:29.947330 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-d5297d31-c37a-4cb0-abc6-81d00b34e03f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "3"}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:30.060720 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-d5297d31-c37a-4cb0-abc6-81d00b34e03f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.473989 Aug 10 23:06:30.061776 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 10 23:06:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:06:30.073439 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-82d065fb-5646-42cf-981b-0a11855dd02c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:30.223914 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-82d065fb-5646-42cf-981b-0a11855dd02c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.154098 Aug 10 23:06:30.238682 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1333 bytes} [Wed Aug 10 23:06:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:32.562488 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-d5297d31-c37a-4cb0-abc6-81d00b34e03f admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:32.564167 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-d5297d31-c37a-4cb0-abc6-81d00b34e03f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002108 Aug 10 23:06:32.564560 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:33.008428 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-73ad55c6-2f24-4bc5-9258-6f55b3de9c9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0}} {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:33.015077 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:33.116789 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-73ad55c6-2f24-4bc5-9258-6f55b3de9c9a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.545625 Aug 10 23:06:33.117485 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 10 23:06:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:06:33.131089 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-2b621637-7bd5-4091-9a51-acf8e2766035 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:33.258236 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-2b621637-7bd5-4091-9a51-acf8e2766035 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130560 Aug 10 23:06:33.258756 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1333 bytes} [Wed Aug 10 23:06:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:35.524376 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-73ad55c6-2f24-4bc5-9258-6f55b3de9c9a admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:35.525582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-73ad55c6-2f24-4bc5-9258-6f55b3de9c9a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Aug 10 23:06:35.525979 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:35.982075 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-fdee6ec8-344d-400f-9ef7-d1349889e010 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:36.076772 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-fdee6ec8-344d-400f-9ef7-d1349889e010 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.543987 Aug 10 23:06:36.077612 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 10 23:06:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:06:36.092301 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-9c227c1f-ec28-4934-990f-2e0d3003af58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:36.302982 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-9c227c1f-ec28-4934-990f-2e0d3003af58 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.215368 Aug 10 23:06:36.321856 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1333 bytes} [Wed Aug 10 23:06:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:56.579872 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-fdee6ec8-344d-400f-9ef7-d1349889e010 admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:56.580893 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-fdee6ec8-344d-400f-9ef7-d1349889e010 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 10 23:06:56.581317 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:56.592378 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:56.990616 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-054ae154-94a1-463b-8eb3-3d6afcd4db47 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:57.009054 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-054ae154-94a1-463b-8eb3-3d6afcd4db47 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.421522 Aug 10 23:06:57.009518 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1292 bytes} [Wed Aug 10 23:06:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:06:58.075611 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-fdee6ec8-344d-400f-9ef7-d1349889e010 admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:58.076651 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-fdee6ec8-344d-400f-9ef7-d1349889e010 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 10 23:06:58.077017 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:06:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:58.635165 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-48fa6e45-990e-40cb-9a6f-a24c7065c2ce admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:58.641375 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.wsgi [None req-48fa6e45-990e-40cb-9a6f-a24c7065c2ce admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-48fa6e45-990e-40cb-9a6f-a24c7065c2ce admin admin] Request method failure captured: Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Accept: application/json Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Accept-Encoding: gzip, deflate Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Connection: keep-alive Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Content-Length: 0 Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Host: 10.222.0.78 Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Openstack-Api-Version: compute 2.90 Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Openstack-System-Scope: None Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: User-Agent: python-novaclient Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Auth-Token: gAAAAABi9DoRL7nMSIKjURVchbtrzr_FJERV0xbJgvIhUXR-T-eI4Px2sc4OLUe3b6jnnrJ0Z-Ih4HFpY-NXlpY8wu9w-IoDxAkt2rLUYjiN3q53fT8A91s7MdVB6t4z-g_8yZz4MBp2JhrXUKy5dAdNFbYyrsn3M_RI881HpWynNnstwtLvzzY Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Domain-Id: None Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Domain-Name: None Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Identity-Status: Confirmed Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Is-Admin-Project: True Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Domain-Id: default Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Domain-Name: Default Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Name: admin Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Role: reader,admin,member Aug 10 23:06:58.644702 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Roles: reader,admin,member Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_669ea2e08a3a4675928c19c0f5a75735", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Tenant: admin Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Tenant-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Tenant-Name: admin Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User: admin Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Domain-Id: default Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Domain-Name: Default Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Id: e793eb6ffc5c41a282b74540f29c0a31 Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Name: admin Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: method: > Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: exception: Flavor 42 could not be found. Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: action_args: {'id': '42'} Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:58.650940 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:58.652042 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:06:58.654117 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-48fa6e45-990e-40cb-9a6f-a24c7065c2ce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:58.655482 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-48fa6e45-990e-40cb-9a6f-a24c7065c2ce admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.430858 Aug 10 23:06:58.655482 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Aug 10 23:06:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:06:58.660427 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-36a157bb-4d4e-4c43-b48b-24b3afc57317 admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:58.664650 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:58.682997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-36a157bb-4d4e-4c43-b48b-24b3afc57317 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026199 Aug 10 23:06:58.683545 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 10 23:06:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:06:58.693371 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-5240240b-5a0a-4db7-8187-65661285512b admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:58.718882 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-5240240b-5a0a-4db7-8187-65661285512b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029043 Aug 10 23:06:58.719452 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 10 23:06:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:06:58.729101 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-7cbdef66-6717-45d5-8a2b-adc3a866877d admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:58.735162 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.wsgi [None req-7cbdef66-6717-45d5-8a2b-adc3a866877d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-7cbdef66-6717-45d5-8a2b-adc3a866877d admin admin] Request method failure captured: Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Accept: application/json Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Accept-Encoding: gzip, deflate Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Connection: keep-alive Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Content-Length: 0 Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Host: 10.222.0.78 Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Openstack-Api-Version: compute 2.90 Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Openstack-System-Scope: None Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: User-Agent: python-novaclient Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Auth-Token: gAAAAABi9DoRL7nMSIKjURVchbtrzr_FJERV0xbJgvIhUXR-T-eI4Px2sc4OLUe3b6jnnrJ0Z-Ih4HFpY-NXlpY8wu9w-IoDxAkt2rLUYjiN3q53fT8A91s7MdVB6t4z-g_8yZz4MBp2JhrXUKy5dAdNFbYyrsn3M_RI881HpWynNnstwtLvzzY Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Domain-Id: None Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Domain-Name: None Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Identity-Status: Confirmed Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Is-Admin-Project: True Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Domain-Id: default Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Domain-Name: Default Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Name: admin Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Role: reader,admin,member Aug 10 23:06:58.738410 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Roles: reader,admin,member Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_669ea2e08a3a4675928c19c0f5a75735", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Tenant: admin Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Tenant-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Tenant-Name: admin Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User: admin Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Domain-Id: default Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Domain-Name: Default Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Id: e793eb6ffc5c41a282b74540f29c0a31 Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Name: admin Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: method: > Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: exception: Flavor 42 could not be found. Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: action_args: {'id': '42'} Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:58.739997 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:58.740968 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:06:58.742086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-7cbdef66-6717-45d5-8a2b-adc3a866877d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:58.743136 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-7cbdef66-6717-45d5-8a2b-adc3a866877d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014668 Aug 10 23:06:58.743136 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Aug 10 23:06:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:06:59.729184 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-5240240b-5a0a-4db7-8187-65661285512b admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:59.730234 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-5240240b-5a0a-4db7-8187-65661285512b admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 10 23:06:59.730623 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:00.257577 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-972c5066-0d7e-4dd2-92e9-52ca9e7534dc admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:00.263490 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.wsgi [None req-972c5066-0d7e-4dd2-92e9-52ca9e7534dc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-972c5066-0d7e-4dd2-92e9-52ca9e7534dc admin admin] Request method failure captured: Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Accept: application/json Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Accept-Encoding: gzip, deflate Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Connection: keep-alive Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Content-Length: 0 Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Host: 10.222.0.78 Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Openstack-Api-Version: compute 2.90 Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Openstack-System-Scope: None Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: User-Agent: python-novaclient Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Auth-Token: gAAAAABi9DoTzxCJxNV6p8LvcSGd4U4iH-k2XNvGcq3T2FznBUZq8sqS0_oAfSUYqnGCm5-AMGJ4DmvoHTHodAAqkOC6bLUemxw5zPYyROvMyzRuxnNc2V8lpNh202L0IgWt4uF37HyBELpH6sPbbKYAwT45yFwB0igsakdFO35ZjDomuhpOxqw Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Domain-Id: None Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Domain-Name: None Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Identity-Status: Confirmed Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Is-Admin-Project: True Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Domain-Id: default Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Domain-Name: Default Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Name: admin Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Role: reader,admin,member Aug 10 23:07:00.264967 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Roles: reader,admin,member Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_669ea2e08a3a4675928c19c0f5a75735", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Tenant: admin Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Tenant-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Tenant-Name: admin Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User: admin Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Domain-Id: default Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Domain-Name: Default Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Id: e793eb6ffc5c41a282b74540f29c0a31 Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Name: admin Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: method: > Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: exception: Flavor 84 could not be found. Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: action_args: {'id': '84'} Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:00.266540 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:00.267457 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:07:00.268554 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-972c5066-0d7e-4dd2-92e9-52ca9e7534dc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:00.269597 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-972c5066-0d7e-4dd2-92e9-52ca9e7534dc admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398230 Aug 10 23:07:00.269597 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Aug 10 23:06:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:00.275946 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-e20a7ea5-695f-4736-b65c-c527ff2304ab admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:00.291486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-e20a7ea5-695f-4736-b65c-c527ff2304ab admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019073 Aug 10 23:07:00.291944 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 10 23:07:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:07:00.301294 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-3c312ad1-92cf-4c3b-ad71-5bfd5e4d3d77 admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:00.316471 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-3c312ad1-92cf-4c3b-ad71-5bfd5e4d3d77 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018672 Aug 10 23:07:00.316987 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 10 23:07:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:00.326748 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-53a60843-4139-404f-8cab-8fa642bef832 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:00.331987 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.wsgi [None req-53a60843-4139-404f-8cab-8fa642bef832 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-53a60843-4139-404f-8cab-8fa642bef832 admin admin] Request method failure captured: Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Accept: application/json Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Accept-Encoding: gzip, deflate Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Connection: keep-alive Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Content-Length: 0 Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Host: 10.222.0.78 Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Openstack-Api-Version: compute 2.90 Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Openstack-System-Scope: None Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: User-Agent: python-novaclient Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Auth-Token: gAAAAABi9DoTzxCJxNV6p8LvcSGd4U4iH-k2XNvGcq3T2FznBUZq8sqS0_oAfSUYqnGCm5-AMGJ4DmvoHTHodAAqkOC6bLUemxw5zPYyROvMyzRuxnNc2V8lpNh202L0IgWt4uF37HyBELpH6sPbbKYAwT45yFwB0igsakdFO35ZjDomuhpOxqw Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Domain-Id: None Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Domain-Name: None Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Identity-Status: Confirmed Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Is-Admin-Project: True Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Domain-Id: default Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Domain-Name: Default Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Name: admin Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Role: reader,admin,member Aug 10 23:07:00.333486 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Roles: reader,admin,member Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_669ea2e08a3a4675928c19c0f5a75735", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Tenant: admin Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Tenant-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Tenant-Name: admin Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User: admin Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Domain-Id: default Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Domain-Name: Default Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Id: e793eb6ffc5c41a282b74540f29c0a31 Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Name: admin Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: method: > Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: exception: Flavor 84 could not be found. Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: action_args: {'id': '84'} Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:00.335112 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:00.336020 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:07:00.337111 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-53a60843-4139-404f-8cab-8fa642bef832 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:00.338139 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-53a60843-4139-404f-8cab-8fa642bef832 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012348 Aug 10 23:07:00.338139 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Aug 10 23:07:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:01.297081 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-3c312ad1-92cf-4c3b-ad71-5bfd5e4d3d77 admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:01.298082 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-3c312ad1-92cf-4c3b-ad71-5bfd5e4d3d77 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 10 23:07:01.298466 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:07:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:01.827586 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-015ad149-73f1-452d-a82e-edf0742f27fa admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.wsgi [None req-015ad149-73f1-452d-a82e-edf0742f27fa admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-015ad149-73f1-452d-a82e-edf0742f27fa admin admin] Request method failure captured: Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Accept: application/json Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Accept-Encoding: gzip, deflate Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Connection: keep-alive Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Content-Length: 0 Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Host: 10.222.0.78 Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Openstack-Api-Version: compute 2.90 Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Openstack-System-Scope: None Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: User-Agent: python-novaclient Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Auth-Token: gAAAAABi9DoVf67Q2NHqDFdWOdPgGBeKBjIiI8U9vC-thTtUKiqWSjqbzwiy8wHfx7ivqKGpbWA4IGSlpxcLgqMZ_rHvU3B8FWzsEt7JjptKwFgG49FjDaQu_EMF3snmhlANbcP85Z-7NxLLcQPo8Sw5w6oN2aSkXGffrvKo-Bgl1bOebG1gSME Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Domain-Id: None Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Domain-Name: None Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Identity-Status: Confirmed Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Is-Admin-Project: True Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Domain-Id: default Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Domain-Name: Default Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Project-Name: admin Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Role: reader,admin,member Aug 10 23:07:01.836915 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Roles: reader,admin,member Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_669ea2e08a3a4675928c19c0f5a75735", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Tenant: admin Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Tenant-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-Tenant-Name: admin Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User: admin Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Domain-Id: default Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Domain-Name: Default Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Id: e793eb6ffc5c41a282b74540f29c0a31 Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: X-User-Name: admin Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: method: > Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: exception: Flavor 451 could not be found. Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: action_args: {'id': '451'} Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:01.838582 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:01.839703 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: ERROR nova.api.openstack.wsgi Aug 10 23:07:01.841052 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-015ad149-73f1-452d-a82e-edf0742f27fa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:01.843021 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-015ad149-73f1-452d-a82e-edf0742f27fa admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397977 Aug 10 23:07:01.843021 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 10 23:07:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:01.846481 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-3545f9d9-7b80-4d3f-957c-f2a6fd1e17af admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:01.862253 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-3545f9d9-7b80-4d3f-957c-f2a6fd1e17af admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019355 Aug 10 23:07:01.862858 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 10 23:07:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:01.872303 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:01.887114 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018319 Aug 10 23:07:01.887649 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 10 23:07:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:01.896985 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-84601555-6481-466d-948a-964ee9c0e6ab admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:01.902471 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.wsgi [None req-84601555-6481-466d-948a-964ee9c0e6ab admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-84601555-6481-466d-948a-964ee9c0e6ab admin admin] Request method failure captured: Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Accept: application/json Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Accept-Encoding: gzip, deflate Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Connection: keep-alive Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Content-Length: 0 Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Host: 10.222.0.78 Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Openstack-Api-Version: compute 2.90 Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Openstack-System-Scope: None Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: User-Agent: python-novaclient Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Auth-Token: gAAAAABi9DoVf67Q2NHqDFdWOdPgGBeKBjIiI8U9vC-thTtUKiqWSjqbzwiy8wHfx7ivqKGpbWA4IGSlpxcLgqMZ_rHvU3B8FWzsEt7JjptKwFgG49FjDaQu_EMF3snmhlANbcP85Z-7NxLLcQPo8Sw5w6oN2aSkXGffrvKo-Bgl1bOebG1gSME Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Domain-Id: None Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Domain-Name: None Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Identity-Status: Confirmed Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Is-Admin-Project: True Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Domain-Id: default Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Domain-Name: Default Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Project-Name: admin Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Role: reader,admin,member Aug 10 23:07:01.904510 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Roles: reader,admin,member Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/669ea2e08a3a4675928c19c0f5a75735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_669ea2e08a3a4675928c19c0f5a75735", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Tenant: admin Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Tenant-Id: 669ea2e08a3a4675928c19c0f5a75735 Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-Tenant-Name: admin Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User: admin Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Domain-Id: default Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Domain-Name: Default Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Id: e793eb6ffc5c41a282b74540f29c0a31 Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: X-User-Name: admin Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: method: > Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: exception: Flavor 451 could not be found. Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: action_args: {'id': '451'} Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:01.906117 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:01.907409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: ERROR nova.api.openstack.wsgi Aug 10 23:07:01.908701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-84601555-6481-466d-948a-964ee9c0e6ab admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:01.910077 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-84601555-6481-466d-948a-964ee9c0e6ab admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012446 Aug 10 23:07:01.910077 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 10 23:07:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:02.879499 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:02.895072 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 10 23:07:02.895072 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:03.405086 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-146f90ce-6b4c-4380-946f-1a167faaad06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:03.487049 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-146f90ce-6b4c-4380-946f-1a167faaad06 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.468788 Aug 10 23:07:03.487606 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Aug 10 23:07:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:07:04.462786 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:04.463818 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 10 23:07:04.464208 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:04.985063 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-24b09777-f64e-4433-a6e4-2365566947b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:05.127245 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-24b09777-f64e-4433-a6e4-2365566947b5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.525152 Aug 10 23:07:05.127749 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Aug 10 23:07:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:07:06.142409 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:06.143441 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 10 23:07:06.143832 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:07:06.787232 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-8d40b8c5-287c-4301-b002-a76cebd677ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:06.908317 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-8d40b8c5-287c-4301-b002-a76cebd677ee admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.628892 Aug 10 23:07:06.908886 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Aug 10 23:07:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:07:07.902717 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:07.903716 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 10 23:07:07.904101 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:07:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:08.426585 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-643ef26b-cbae-4928-b9dc-e23e117dcc26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:08.572500 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-643ef26b-cbae-4928-b9dc-e23e117dcc26 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.531145 Aug 10 23:07:08.572982 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Aug 10 23:07:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:07:09.537364 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:09.538674 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Aug 10 23:07:09.539075 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:10.068494 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-6cf0f67f-cbfe-4ddb-9525-0b4f3386f46d admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:10.088684 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-6cf0f67f-cbfe-4ddb-9525-0b4f3386f46d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412165 Aug 10 23:07:10.089220 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Wed Aug 10 23:07:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:08:01.913429 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:01.914446 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-acf7728f-b5a4-4055-be41-eca923dbefb5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 10 23:08:01.914899 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 10 23:08:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:01.925519 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:02.308025 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-1ebf6785-7dec-4357-a486-01fc2a69defd admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:02.328883 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-1ebf6785-7dec-4357-a486-01fc2a69defd admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407827 Aug 10 23:08:02.329361 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1292 bytes} [Wed Aug 10 23:08:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:08:02.350394 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG dbcounter [-] [106228] Writing DB stats nova_api:SELECT=14 {{(pid=106228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:02.354124 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-7e79e19c-46f1-494e-a2b3-34ddac8d018b admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:02.362510 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-7e79e19c-46f1-494e-a2b3-34ddac8d018b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013564 Aug 10 23:08:02.363088 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1283 bytes} [Wed Aug 10 23:08:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:02.375202 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-47f5a281-50d4-456a-937c-3b58e509bb35 admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:02.382825 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-47f5a281-50d4-456a-937c-3b58e509bb35 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011785 Aug 10 23:08:02.385536 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1286 bytes} [Wed Aug 10 23:08:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:02.394936 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-a0fda7c0-28d2-47b2-ac98-43891d9ab9cb admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:02.402782 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-a0fda7c0-28d2-47b2-ac98-43891d9ab9cb admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011737 Aug 10 23:08:02.404446 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1286 bytes} [Wed Aug 10 23:08:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:02.414719 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-bf2d7736-d4d6-4a7f-8066-ea40983d7aca admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:02.423217 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-bf2d7736-d4d6-4a7f-8066-ea40983d7aca admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012180 Aug 10 23:08:02.423885 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1283 bytes} [Wed Aug 10 23:08:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:25.487636 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-a0fda7c0-28d2-47b2-ac98-43891d9ab9cb admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:25.488651 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-a0fda7c0-28d2-47b2-ac98-43891d9ab9cb admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 10 23:11:25.489039 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:11:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:25.630575 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writing DB stats nova_api:SELECT=6 {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:25.785956 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-d2649958-0735-46f0-9d06-5870991cd36e admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:25.788309 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:11:25.788309 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: warnings.warn(msg) Aug 10 23:11:25.789431 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d2649958-0735-46f0-9d06-5870991cd36e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:25.789906 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d2649958-0735-46f0-9d06-5870991cd36e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:25.790331 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d2649958-0735-46f0-9d06-5870991cd36e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:25.791072 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d2649958-0735-46f0-9d06-5870991cd36e admin admin] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:25.791511 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d2649958-0735-46f0-9d06-5870991cd36e admin admin] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:25.791930 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d2649958-0735-46f0-9d06-5870991cd36e admin admin] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:25.825934 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-d2649958-0735-46f0-9d06-5870991cd36e admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197329 Aug 10 23:11:25.826493 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 10 23:11:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:11:26.657448 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-a0fda7c0-28d2-47b2-ac98-43891d9ab9cb admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:26.658458 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-a0fda7c0-28d2-47b2-ac98-43891d9ab9cb admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 10 23:11:26.659073 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:11:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:26.849992 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-d161db80-a0b0-4011-9a3b-2d30e8850a2f admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:26.852451 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:11:26.852451 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: warnings.warn(msg) Aug 10 23:11:26.853612 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d161db80-a0b0-4011-9a3b-2d30e8850a2f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:26.854088 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d161db80-a0b0-4011-9a3b-2d30e8850a2f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:26.854513 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d161db80-a0b0-4011-9a3b-2d30e8850a2f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:26.855254 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d161db80-a0b0-4011-9a3b-2d30e8850a2f admin admin] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:26.855701 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d161db80-a0b0-4011-9a3b-2d30e8850a2f admin admin] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:26.856116 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-d161db80-a0b0-4011-9a3b-2d30e8850a2f admin admin] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:26.875269 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-d161db80-a0b0-4011-9a3b-2d30e8850a2f admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076611 Aug 10 23:11:26.875820 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 10 23:11:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:11:38.128103 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-a0fda7c0-28d2-47b2-ac98-43891d9ab9cb admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:38.129161 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-a0fda7c0-28d2-47b2-ac98-43891d9ab9cb admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 10 23:11:38.129557 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 36/73] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:11:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:38.270906 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writing DB stats nova_cell0:SELECT=4 {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:38.272236 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writing DB stats nova_cell1:SELECT=4 {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:38.272879 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG dbcounter [-] [106229] Writing DB stats nova_api:SELECT=8 {{(pid=106229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:38.320000 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-bd2a7773-286d-486d-b25c-aa9a540b1e2a admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:38.322409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:11:38.322409 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: warnings.warn(msg) Aug 10 23:11:38.323558 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-bd2a7773-286d-486d-b25c-aa9a540b1e2a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:38.333851 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-bd2a7773-286d-486d-b25c-aa9a540b1e2a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:38.333851 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-bd2a7773-286d-486d-b25c-aa9a540b1e2a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:38.333851 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-bd2a7773-286d-486d-b25c-aa9a540b1e2a admin admin] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:38.333851 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-bd2a7773-286d-486d-b25c-aa9a540b1e2a admin admin] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:38.334920 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-bd2a7773-286d-486d-b25c-aa9a540b1e2a admin admin] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:38.351926 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-bd2a7773-286d-486d-b25c-aa9a540b1e2a admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085485 Aug 10 23:11:38.352456 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 38/74] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 10 23:11:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:11:39.182858 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: DEBUG nova.api.openstack.wsgi [None req-a0fda7c0-28d2-47b2-ac98-43891d9ab9cb admin admin] Calling method '>' {{(pid=106228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:39.183862 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: INFO nova.api.openstack.requestlog [None req-a0fda7c0-28d2-47b2-ac98-43891d9ab9cb admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 10 23:11:39.184258 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: [pid: 106228|app: 0|req: 37/75] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 10 23:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:39.375513 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG nova.api.openstack.wsgi [None req-7686b179-ade5-4d4a-9e90-9bb24e4ca295 admin admin] Calling method '>' {{(pid=106229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:39.377942 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:11:39.377942 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: warnings.warn(msg) Aug 10 23:11:39.379081 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-7686b179-ade5-4d4a-9e90-9bb24e4ca295 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:39.379555 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-7686b179-ade5-4d4a-9e90-9bb24e4ca295 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:39.380014 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-7686b179-ade5-4d4a-9e90-9bb24e4ca295 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:39.381413 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-7686b179-ade5-4d4a-9e90-9bb24e4ca295 admin admin] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:39.381862 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-7686b179-ade5-4d4a-9e90-9bb24e4ca295 admin admin] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:39.382278 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: DEBUG oslo_concurrency.lockutils [None req-7686b179-ade5-4d4a-9e90-9bb24e4ca295 admin admin] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:39.403661 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: INFO nova.api.openstack.requestlog [None req-7686b179-ade5-4d4a-9e90-9bb24e4ca295 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079955 Aug 10 23:11:39.404135 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: [pid: 106229|app: 0|req: 39/76] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 10 23:11:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:12:35.042687 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: Wed Aug 10 23:12:35 2022 - graceful shutdown triggered... Aug 10 23:12:35.040731 dv-cinder-851449-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 23:12:35.043701 dv-cinder-851449-5-iscsi devstack@n-api.service[106228]: Gracefully killing worker 1 (pid: 106228)... Aug 10 23:12:35.044094 dv-cinder-851449-5-iscsi devstack@n-api.service[106229]: Gracefully killing worker 2 (pid: 106229)... Aug 10 23:12:36.041555 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: worker 1 buried after 1 seconds Aug 10 23:12:36.041764 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: worker 2 buried after 1 seconds Aug 10 23:12:36.041764 dv-cinder-851449-5-iscsi devstack@n-api.service[106227]: goodbye to uWSGI. Aug 10 23:12:36.043653 dv-cinder-851449-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 23:12:36.044203 dv-cinder-851449-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 23:12:36.047059 dv-cinder-851449-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 23:12:36.057151 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 23:12:36 2022] *** Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: nodename: dv-cinder-851449-5-iscsi Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: machine: x86_64 Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: clock source: unix Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: pcre jit disabled Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: detected number of CPU cores: 4 Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: current working directory: / Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: detected binary path: /usr/bin/uwsgi-core Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: your processes number limit is 47680 Aug 10 23:12:36.059177 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: your memory page size is 4096 bytes Aug 10 23:12:36.060118 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: detected max file descriptor number: 2048 Aug 10 23:12:36.060118 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: lock engine: pthread robust mutexes Aug 10 23:12:36.060118 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: thunder lock: enabled Aug 10 23:12:36.060118 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 23:12:36.060118 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 23:12:36.100074 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: Python main interpreter initialized at 0x55a744d7f9c0 Aug 10 23:12:36.100074 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: python threads support enabled Aug 10 23:12:36.100074 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: your server socket listen backlog is limited to 100 connections Aug 10 23:12:36.100074 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: your mercy for graceful operations on workers is 90 seconds Aug 10 23:12:36.100500 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 23:12:36.100500 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: *** Operational MODE: preforking *** Aug 10 23:12:36.100774 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: *** uWSGI is running in multiple interpreter mode *** Aug 10 23:12:36.100774 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: spawned uWSGI master process (pid: 121321) Aug 10 23:12:36.100980 dv-cinder-851449-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 23:12:36.101495 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: spawned uWSGI worker 1 (pid: 121332, cores: 1) Aug 10 23:12:36.102692 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: spawned uWSGI worker 2 (pid: 121333, cores: 1) Aug 10 23:12:36.102692 dv-cinder-851449-5-iscsi devstack@n-api.service[121321]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 23:12:36.779447 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 23:12:36.789779 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 23:12:37.963075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 23:12:37.963075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: from cryptography.utils import int_from_bytes Aug 10 23:12:37.964492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 23:12:37.964492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: from cryptography.utils import int_from_bytes Aug 10 23:12:37.964637 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 23:12:37.964637 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: from cryptography.utils import int_from_bytes Aug 10 23:12:37.965036 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 23:12:37.965036 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: from cryptography.utils import int_from_bytes Aug 10 23:12:40.272401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 23:12:40.273084 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 23:12:40.273180 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 23:12:40.273536 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 23:12:40.273792 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 23:12:40.274177 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.274503 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.274855 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.275178 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.275504 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.275816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.276138 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.277033 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.277364 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.277629 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.277948 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.278286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-5-iscsi {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.278600 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.278932 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.279247 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.279564 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.279871 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.280194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.280501 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.281005 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.281459 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.281779 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.282072 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.282608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.282742 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.283041 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.283411 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.283674 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.283997 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.284309 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.284707 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-5-iscsi {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.285045 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.285328 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.285640 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.286051 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.286363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.286691 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.287019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.287355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.287668 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.287995 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.289121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.289121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.289121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.289397 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.289524 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.289833 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.290149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.290452 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.290797 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.291053 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.291364 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.291687 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.292053 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.292178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 23:12:40.292608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.292719 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 23:12:40.292816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.292914 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.293017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 23:12:40.293160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.293321 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 23:12:40.293484 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.293595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 23:12:40.293793 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.293946 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.294100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.294278 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.294407 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.294604 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.294722 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.294959 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.295054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.295295 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.295397 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.295610 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.295705 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.295919 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.296021 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.296237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.296340 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.296553 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.296654 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.296820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.296923 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.297143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.297253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.297469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-5-iscsi {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.297572 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.297794 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.297898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.298103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.298204 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.298413 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.298523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.298758 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.298881 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.299078 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.299174 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.299380 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.299494 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.299694 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.299801 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.300014 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.300202 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.300317 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.300524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.300628 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.300833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.300935 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.301146 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.301241 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.301489 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.301600 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.301807 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.301909 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.302055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.302173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.302359 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.302471 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.302703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.302798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.303001 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.303103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.303307 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.303410 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.303614 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.303752 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-5-iscsi {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.303921 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.304057 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.304221 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.304371 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.304527 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.304684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.304833 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.305098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.305201 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.305416 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.305517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.305726 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.305827 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.306029 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.306131 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.306334 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.306429 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.306636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.306766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.306960 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.307061 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.307301 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.307403 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.307613 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.307734 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.307949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.308055 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.308227 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309055 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309156 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309241 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309315 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309501 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309574 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309724 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309803 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.309876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.310039 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.310137 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.310303 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.310386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.310603 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.310708 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.310947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.311033 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.311255 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.311338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.311547 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.311639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.311803 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.312992 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.313094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.313193 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.313282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.313439 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.313530 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.313628 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.313715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.313807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.313807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.313988 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.314075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.314160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.314253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.314345 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.314444 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.314536 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.314629 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.315600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.315600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.315800 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.315886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.315960 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316030 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316179 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316264 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316356 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316480 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316583 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316678 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316678 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.316978 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.317065 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.317286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.317390 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.317625 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.317728 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.317945 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.318040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.318258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.318353 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.318580 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.318715 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.318938 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.319047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.319251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.319379 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.319564 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.319660 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.319875 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.319968 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.320193 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.320306 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.320517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.320619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.320825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.321001 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.321098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.321205 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.321370 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.321516 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.321679 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.321836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.322000 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.322166 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.322310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.322484 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.322622 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.322823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.322976 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.323705 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.323857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.323976 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.324173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.324278 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.324487 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.324589 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.324800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.324895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.325113 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.325213 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.325425 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.325534 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.325734 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.325835 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.326046 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.326168 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.326355 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.326486 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.326695 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.326845 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.327029 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.327169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.327352 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.327487 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.327666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.327798 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.327977 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.328109 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.328287 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.328431 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.328596 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.328766 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.328919 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.329079 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.329232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.329396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.329542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.329709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.329869 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.330021 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.330181 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.330331 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.330497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.330642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.330848 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.330979 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.331162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.331318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.331473 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.331634 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.331798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.331950 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.332103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.332262 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.332414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.332580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.332735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.332892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.333047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.333206 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.333355 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.333518 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.333661 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.333827 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.333985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.334134 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.334302 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.334461 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.334557 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.334764 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.334906 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.335111 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.335260 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.335423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.335571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.335720 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.335871 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.336022 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.336166 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.336327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.336470 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.336608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.336750 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.336880 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.337021 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.337176 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.337323 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 23:12:40.337472 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.337613 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.337781 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.337933 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.338097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.338250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.338392 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.338539 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.338752 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.339582 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.339729 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.339882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.340064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.340160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.340236 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.340467 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.340574 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.340751 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.340860 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.341052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.341174 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.341401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.341715 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.341844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.342033 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.342141 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.342350 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.342455 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.342690 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.342807 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.343015 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.343119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.343333 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.343442 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.343649 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.343758 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.343990 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.344103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.344331 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.344453 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.344651 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.344755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.344985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.345098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.345318 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.345425 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.345654 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.345758 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.345971 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.346089 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.346282 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.346701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.346967 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.347072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.347221 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.347341 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.347511 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.347607 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.347852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.347955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.348126 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.348238 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.348432 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.348541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.348736 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.348837 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.349043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.349157 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.349349 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.349467 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.349689 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.349793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.349976 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.350077 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.350282 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.350382 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.350585 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.350770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.351053 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.351165 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.351250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.351326 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.351555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.351657 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.351899 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.352009 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.352219 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.352326 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.352544 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.352653 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.352866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.352975 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.353180 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.353286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.353498 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.353665 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.353823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.353979 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.354213 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.354366 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.354521 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.354704 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.354860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.355027 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.355257 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.355497 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.355661 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.355918 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.356074 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.356221 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.356375 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.356530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.356722 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.356889 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.357058 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.357299 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.357452 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.357606 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.357769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.357945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.358143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.358303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.358450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.358606 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.358791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.358941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.359088 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.359243 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.359391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.359537 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.359693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.359928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.360093 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.360242 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.360542 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.360699 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.360854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.361009 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.361254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.361409 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.361570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.361725 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.361880 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.362028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.362185 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.362341 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.362499 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.362672 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.362828 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.362985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.363143 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.363300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.363458 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.363617 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.363771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.363926 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.364091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.364267 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.364498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.364654 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.364808 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.364955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.365101 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.365101 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.365497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.365727 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.365896 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.366138 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.366290 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.366648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.366904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.367098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.367287 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.367555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.367768 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.368483 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.368723 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.368928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.369140 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.369366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.369366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.369366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.369833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.370080 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.370243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.370243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.370549 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.370731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.370887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.371042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.371042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.371042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.371042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.371783 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.371939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.372148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.372316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.372474 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.372637 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.372795 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.372944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.373089 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.373235 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.373380 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.373535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.373683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.373837 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.373998 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.374144 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.374436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.374436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.374918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.375080 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.375229 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.375376 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.375590 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.375766 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.376002 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.376173 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.376419 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.376609 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.376889 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.377055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.377205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.377360 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.377534 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.377768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.377936 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.378094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.378248 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.378396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.378550 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.378736 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.378918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.379069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.379216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.379361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.379507 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.379662 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.379818 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.379973 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.380218 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.380372 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.380520 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.380676 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.380824 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.380985 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.381132 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.381287 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.381456 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.381683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.381836 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.381990 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.382138 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.382286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.382433 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.382596 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.382782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.382932 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.383091 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.383238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.383396 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.383552 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.383700 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.383854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.384011 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.384159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.384319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.384476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.384624 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.384857 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.385022 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.385177 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.385335 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.385492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.386237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.386419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.386689 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.386983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.387164 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.387164 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.387458 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.387612 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.387784 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.388050 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.388210 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.388364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.388528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.388697 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.388852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.388852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.389151 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.389304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.389465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.389634 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.389789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.389942 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.390105 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.390355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.390516 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.390705 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.390880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.391044 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.391206 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.391371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.391547 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.391795 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.391956 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.392110 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.392286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.392461 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.392625 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.392781 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.392941 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.393103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.393257 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.393410 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.393572 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.393744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.393901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.394054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.394206 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.394378 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.394541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.394757 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.395003 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.395164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.395330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.395495 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.395659 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.395813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.395982 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.396136 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.396379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.396554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.396831 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.397102 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.397266 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.397429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.397592 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.397796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.397960 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.398270 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.398442 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.398442 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.398813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.398813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.399142 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.399318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.399482 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.399636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.399800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.399955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.400117 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.400272 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.400524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.400693 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.400858 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.401021 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.401185 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.401905 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.402158 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.402321 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.402514 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.402734 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.402899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.403062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.403227 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.403396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.403559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.403720 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.403932 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.404097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.404265 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.404435 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.404590 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.404750 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.404904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.405159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.405329 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.405495 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.405650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.405803 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.405958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.406111 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.406274 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.406625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.406838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.407222 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.407386 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.407542 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.407710 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.407865 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.407865 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.408174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.408452 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.408615 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.408787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.408950 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.409128 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.409284 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.409437 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.409599 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.409768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.409924 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.410078 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.410078 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.410370 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.410550 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.410838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.411000 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.411162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.411335 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.411499 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.411656 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.411818 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.411992 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.412176 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.412421 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.412589 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.412745 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.412898 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.413059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.413214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.413461 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.413619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.413773 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.413935 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.414089 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.414258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.414427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.414590 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.414787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.414944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.415106 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.415401 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.415562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.415736 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.415891 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.416045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.416206 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.416374 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.416549 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.416801 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.416980 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.417334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.417504 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.417675 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.417830 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.417983 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.418157 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.418320 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.418502 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.418776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.418948 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.419106 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.419267 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.419429 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.419593 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.419748 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.425835 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.426216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.426412 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.426585 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.426809 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.434800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.435053 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.435234 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.435410 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.435592 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.435787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.435951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.436117 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.436274 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.436495 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.436676 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.436834 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.436996 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.437160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.437377 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.437553 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.437716 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.437882 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.438037 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.438202 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.438358 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.438521 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.438726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.438902 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.439058 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.439212 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.439478 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.439656 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.439819 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.439984 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.440156 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.440311 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.440479 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.440645 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.440801 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.440967 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.441121 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.441283 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.441453 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.441610 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.441772 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.441927 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.442082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.442244 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.442423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.442590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.442795 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.442953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.443119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.443281 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.443445 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.443609 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.443772 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.443927 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.444082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.444487 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.444908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.445073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.445237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.445401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.445558 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.445738 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.445896 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.446065 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.446222 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.446375 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.446537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.446729 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.446899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.447062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.447227 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.447429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.447595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.447761 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.447927 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.448114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.448790 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.448949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.449104 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.449269 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.449443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.449675 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.449845 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.450010 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.450177 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.450332 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.450503 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.450697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.450861 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.451027 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.451196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.451359 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.451523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.451523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.451835 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.451998 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.452168 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.452323 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.452489 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.452664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.452820 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.452975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.453140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.453295 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.453449 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.453611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.453767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.453930 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.454086 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.454247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.454641 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.455109 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.455286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.455452 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.455615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.455772 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.455927 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.455927 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.456221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.456221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.456529 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.456682 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.456837 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.456991 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.457153 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.457334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.460057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.460316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.460570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.460787 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.460972 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.461141 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.461300 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.461462 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.461627 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.461782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.461953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.462124 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.462287 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.462462 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.462639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.462894 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.463134 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.463300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.463466 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.463630 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.463829 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.463993 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.464162 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.464325 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.464515 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.464969 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.465466 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.465641 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.465805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.465970 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.466153 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.466974 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.467144 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.467317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.467481 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.467637 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.467791 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.467957 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.468119 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.468287 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.468451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.468606 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.468606 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.468898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.469059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.469224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.469389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.469544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.469698 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.469913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.470201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.470366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.470527 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.470712 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.470886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.471051 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.471221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.471634 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.471800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.471963 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.472129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.472299 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.472299 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.472636 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.472801 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.472964 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.473119 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.473281 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.473450 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.473615 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.473786 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.473941 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.474095 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.474258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.474413 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.474578 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.475041 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.475327 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.475676 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.475851 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.476016 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.476181 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.476337 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.476491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.476661 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.476824 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.476988 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.477151 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.477326 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.477492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.477658 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.477815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.477969 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.478131 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.478286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.478455 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.478620 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.478854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.479030 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.479195 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.479399 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.479581 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.479738 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.479948 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.480119 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.480363 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.480540 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.480706 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.480870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.481027 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.481189 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.481352 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.481522 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.481701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.481858 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.482013 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.482175 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.482333 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.482502 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.482677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.482852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.483010 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.483171 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.483171 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.483488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.483645 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.483818 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.483985 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.484148 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.484314 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.484468 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.484624 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.484785 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.485156 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.485345 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.485615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.485960 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.486118 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.486282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.486458 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.486570 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.486706 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.486801 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.486902 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.487000 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.487090 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.487220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.487354 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.487470 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.487591 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.487706 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.487820 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.488018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.488135 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.488276 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.488433 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.488558 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.488674 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.488797 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.488920 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.489035 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.489160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.489276 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.489388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.489514 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.489629 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.489629 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.489858 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.490015 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.490148 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.490279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.490488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.490618 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.490761 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.490896 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.491035 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.491151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.491272 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.491395 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.491518 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.491640 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.491763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.491763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.491986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.492115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.492235 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.492350 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.492473 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.492594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.492708 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.492830 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.492965 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.493090 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.493217 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.493332 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.493445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.493557 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.493676 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.493799 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.493914 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.494026 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.494145 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.494266 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.494380 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.494504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.494619 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.494807 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.497761 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.497928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.498104 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.498284 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.498446 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.498604 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.498787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.498967 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.499142 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.499674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.499850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.500174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.500351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.501615 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.501815 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.501982 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.502141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.502307 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.502464 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.502633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.502832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.503000 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.503157 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.503331 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.504084 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.504271 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.504439 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.504603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.504766 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.504932 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.505090 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.505265 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.505436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.505628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.506045 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.506210 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.506373 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.506542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.506804 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.506994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.507353 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.507516 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.507681 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.507959 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.508133 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.508310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.508475 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.508639 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.508806 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.508963 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.509132 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.509287 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.509450 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.509605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.509605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.509910 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.510064 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.510288 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.510449 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.510697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.511377 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.511535 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.511790 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.511961 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.512126 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.512297 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.512454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.512608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.512762 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.512915 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.513080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.513267 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.513503 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.513731 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.513890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.514045 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.514198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.514366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.514532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.514720 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.514882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.515038 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.515207 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.515443 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.515613 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.515769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.516160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.516324 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.516489 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.516645 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.516806 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.516806 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.517100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.517275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.517610 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.517793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.517970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.518212 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.518380 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.518544 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.518753 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.518917 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.519072 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.519072 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.519381 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.519588 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.519768 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.519934 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.520100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.520255 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.520470 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.520636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.520793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.520947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.521100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.521262 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.521425 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.521590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.521764 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.521998 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.522157 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.522331 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.522487 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.522674 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.522850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.523007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.523162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.523324 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.523566 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.523732 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.523732 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.524625 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.524793 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.524962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.524962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.524962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.524962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.524962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.525716 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.525872 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.526327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.526494 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.526678 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.526856 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.527022 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.527198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.527354 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.527535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.527877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.528049 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.528226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.528487 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.528649 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.528803 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.528965 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.529130 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.529293 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.529459 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.529634 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.529798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.529955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.530120 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.530275 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.530490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.530668 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.530844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.531001 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.531164 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.531331 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.531494 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.531670 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.531833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.532008 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.532240 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.532414 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.532577 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.532745 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.532900 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.533068 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.533068 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.533378 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.533535 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.533697 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.533863 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.534041 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.534041 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.534347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.534347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.534347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.534347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.534347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.534347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.535265 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.535265 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.535265 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.535823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.535987 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.535987 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.536539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.536539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.536848 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.536848 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.536848 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.536848 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.537450 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.537450 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.537450 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.538073 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.538264 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.538439 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.538597 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.538882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.539052 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.539215 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.539380 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.539545 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.539708 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.539708 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.539708 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.540139 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.540399 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.540636 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.540809 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.540966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.541120 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.541291 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.541460 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.541624 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.541806 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.541970 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.542131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.542404 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.542566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.542833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.543003 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.543160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.543315 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.543479 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.543636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.543801 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.543965 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.544129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.544301 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.544467 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.544632 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.544789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.544971 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.545140 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.545306 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.545462 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.545630 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.545797 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.545961 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.546116 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.546280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.546871 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.546871 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.547854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.548303 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.548479 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.548635 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.548796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.549120 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.549283 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.549440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.549618 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.549782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.549950 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.550122 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.550290 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.550447 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.550746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.550930 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.551088 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.551260 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.551416 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.551578 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.551745 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.551909 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.552074 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.552240 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.552416 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.552728 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.552891 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.553048 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.553213 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.553382 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.553546 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.553701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.553855 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.554057 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.554230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.554393 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.554558 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.554759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.554928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.555099 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.555266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.555430 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.555585 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.555741 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.555894 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.556058 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.556214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.556385 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.556572 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.556572 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.557250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.558021 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.558187 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.558677 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.558859 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.559027 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.559027 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.559497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.559664 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.559819 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.559982 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.560138 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.560311 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.560482 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.560637 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.560861 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.561029 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.561185 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.561355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.561513 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.561671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.561835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.561999 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.562163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.562334 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.562498 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.562723 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.562889 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.563061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.563226 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.563392 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.563555 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.563720 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.563862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.564022 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.564193 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.564350 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.564513 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.564727 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.564835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.564929 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565026 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565118 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565297 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565386 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565474 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565577 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565669 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565768 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565867 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.565958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.566137 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.566276 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.566417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.566522 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.566615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.566745 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.566868 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.567033 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.567307 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.567409 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.567509 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.567608 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.567715 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.567815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.567919 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.568011 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.568115 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.568214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.568314 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.568407 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.568514 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.568602 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.569001 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.569158 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.569303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.569620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.569801 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.569953 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.570050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.570157 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.570250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.570340 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.570437 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.570536 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.570641 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.570797 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.570958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.571061 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.571201 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.571345 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.571501 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.571597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.571696 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.571787 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.571877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.571966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.572064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.572064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.572229 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.572318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.572421 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.572512 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.572620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.572712 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.572800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.572897 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.573109 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.573739 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.573849 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.573849 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.574014 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.574112 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.574215 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.574314 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.574413 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.574512 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.574603 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.574726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.574824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.574923 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575014 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575236 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575236 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 23:12:40.575461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.575461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.576754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.577669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.577669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.577669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.577669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.577669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.577669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.577669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.577669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.578292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.578292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.578292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.578292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.578292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.578292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.578292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.578292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.579349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.579349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.579349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.579349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.579349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.579349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.579349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.579349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.580664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.581724 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.581724 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 23:12:40.581724 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 23:12:40.693924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO dbcounter [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Registered counter for database nova_api Aug 10 23:12:40.713375 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO dbcounter [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Registered counter for database nova_api Aug 10 23:12:40.714385 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_db.sqlalchemy.engines [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:12:40.720925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writer thread running {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:12:40.733370 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_db.sqlalchemy.engines [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:12:40.739960 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writer thread running {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:12:40.778679 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.context [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62cffb2b-b617-4f0b-acb7-5b1c401f61ea(cell1) {{(pid=121332) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 23:12:40.782724 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:40.783208 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:40.784807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:40.785744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:40.786455 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:40.788590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:40.790580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO dbcounter [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Registered counter for database nova_cell0 Aug 10 23:12:40.795324 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO dbcounter [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Registered counter for database nova_cell1 Aug 10 23:12:40.798271 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.context [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62cffb2b-b617-4f0b-acb7-5b1c401f61ea(cell1) {{(pid=121333) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 23:12:40.802250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:40.802793 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_db.sqlalchemy.engines [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:12:40.802926 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:40.804423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:40.804582 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_db.sqlalchemy.engines [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:12:40.805409 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:40.806132 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:40.808897 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:40.810773 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writer thread running {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:12:40.810970 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO dbcounter [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Registered counter for database nova_cell0 Aug 10 23:12:40.815048 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO dbcounter [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Registered counter for database nova_cell1 Aug 10 23:12:40.816257 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writer thread running {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:12:40.822290 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_db.sqlalchemy.engines [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:12:40.824071 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_db.sqlalchemy.engines [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:12:40.830029 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writer thread running {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:12:40.831713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writer thread running {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:12:40.960843 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO dbcounter [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Registered counter for database nova_cell0 Aug 10 23:12:40.967735 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_db.sqlalchemy.engines [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:12:40.972751 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writer thread running {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:12:40.980963 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO dbcounter [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Registered counter for database nova_cell0 Aug 10 23:12:40.987626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_db.sqlalchemy.engines [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 23:12:40.992161 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writer thread running {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 23:12:41.295594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: WARNING keystonemiddleware.auth_token [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 23:12:41.302864 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: WARNING keystonemiddleware.auth_token [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 23:12:41.326061 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: WARNING keystonemiddleware.auth_token [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 23:12:41.333493 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: WARNING keystonemiddleware.auth_token [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 23:12:41.651465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: WARNING keystonemiddleware.auth_token [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 23:12:41.657473 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: WARNING keystonemiddleware.auth_token [None req-5a7723b4-6343-49f1-abc2-267d9a4ed100 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 23:12:41.663820 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a744d7f9c0 pid: 121332 (default app) Aug 10 23:12:41.680912 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: WARNING keystonemiddleware.auth_token [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 23:12:41.687520 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: WARNING keystonemiddleware.auth_token [None req-510e29fb-995f-4666-9a8a-cf7ed2ac3d7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 23:12:41.693791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a744d7f9c0 pid: 121333 (default app) Aug 10 23:13:18.227705 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:18.228714 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:18.230080 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:18.230882 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:19.584950 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9da06e60-581a-4b9f-8cab-13b25c14b1ef tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] Action: 'create', calling method: .version_select at 0x7fe841d99e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1459028226", "metadata": {"Type": "work"}}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:22.628551 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9da06e60-581a-4b9f-8cab-13b25c14b1ef tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.419270 Aug 10 23:13:22.639256 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1156 bytes} [Wed Aug 10 23:13:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4433 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 23:13:22.961774 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7f6b85c7-2ee0-4507-ab5b-eddd5aeaf58d tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] Calling method '.version_select at 0x7fe841e79940>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:23.036593 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=3 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:23.036593 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=3 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:23.036593 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=3 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:23.036593 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=3 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:23.723929 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7f6b85c7-2ee0-4507-ab5b-eddd5aeaf58d tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f" status: 200 len: 353 microversion: 2.1 time: 1.080866 Aug 10 23:13:23.725231 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 1/2] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:13:22 2022] GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f => generated 353 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:24.739387 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3abb134b-cbed-48c5-8cb0-2f7e899082f3 tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] Calling method '.version_select at 0x7fe841c91ca0>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:24.897467 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3abb134b-cbed-48c5-8cb0-2f7e899082f3 tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f" status: 200 len: 354 microversion: 2.1 time: 0.162005 Aug 10 23:13:24.898337 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 2/3] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:13:24 2022] GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f => generated 354 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:24.915785 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3b7955c3-845f-45ff-99d8-6849fdd3ea71 tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] Calling method '.version_select at 0x7fe841ccae50>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:25.324457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3b7955c3-845f-45ff-99d8-6849fdd3ea71 tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f" status: 200 len: 354 microversion: 2.1 time: 0.414332 Aug 10 23:13:25.325185 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 2/4] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:13:24 2022] GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f => generated 354 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:25.346404 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-00544059-6380-4b82-9dab-96a940a2996d tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] Calling method '.version_select at 0x7fe841c2f3a0>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:25.751528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-00544059-6380-4b82-9dab-96a940a2996d tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f" status: 202 len: 0 microversion: 2.1 time: 0.410967 Aug 10 23:13:25.753725 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 3/5] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 10 23:13:25 2022] DELETE /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:13:25.763534 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7f3f6e5c-04b4-48e7-9625-435e3c1ff7c0 tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] Calling method '.version_select at 0x7fe841c173a0>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:25.952779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7f3f6e5c-04b4-48e7-9625-435e3c1ff7c0 tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f" status: 200 len: 353 microversion: 2.1 time: 0.194737 Aug 10 23:13:25.953669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 3/6] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:13:25 2022] GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f => generated 353 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:26.967061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-91a30d18-42d6-4c01-a19a-99e91a4ae58b tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] Calling method '.version_select at 0x7fe841c2fa60>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:27.019867 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-91a30d18-42d6-4c01-a19a-99e91a4ae58b tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] HTTP exception thrown: Volume c1f532f4-cbd5-43b8-aff9-0ef8823ad81f could not be found. Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-91a30d18-42d6-4c01-a19a-99e91a4ae58b tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] Request method failure captured: Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f HTTP/1.1 Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DuOVGHlmO9yi7CWXhivAiHg0eKOvRZBv8wHFL_6PvhxfgUV5l1WfiQ_hLKU6jQHSKqzbGTK6jLHIfgYwV3xn8NpHyxPQHiv5EMTrGnnx5x3C0EBL9kR2EiB6lcPkKp9cRv6phi0hfEiw0T6nzdrQYx4EskhWmFrDEfaoZZouMaaqJQ Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 8e5a6e09a2be4042b0010a196f744030 Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-VolumesGetTestJSON-1541111090 Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:13:27.024646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e5a6e09a2be4042b0010a196f744030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e5a6e09a2be4042b0010a196f744030"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e5a6e09a2be4042b0010a196f744030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e5a6e09a2be4042b0010a196f744030", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-VolumesGetTestJSON-1541111090 Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 8e5a6e09a2be4042b0010a196f744030 Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-VolumesGetTestJSON-1541111090 Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-VolumesGetTestJSON-1541111090-project Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 5c252fc819d6480ea720098d14d02574 Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-VolumesGetTestJSON-1541111090-project Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Volume c1f532f4-cbd5-43b8-aff9-0ef8823ad81f could not be found. Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'c1f532f4-cbd5-43b8-aff9-0ef8823ad81f'} Aug 10 23:13:27.025838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1f532f4-cbd5-43b8-aff9-0ef8823ad81f could not be found. (HTTP 404) (Request-ID: req-db911869-eaf7-4579-9187-30f7488f6ce0) Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:13:27.026539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:13:27.027557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1f532f4-cbd5-43b8-aff9-0ef8823ad81f could not be found. Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 23:13:27.029468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1f532f4-cbd5-43b8-aff9-0ef8823ad81f could not be found. Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1f532f4-cbd5-43b8-aff9-0ef8823ad81f could not be found. Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-91a30d18-42d6-4c01-a19a-99e91a4ae58b tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] Returning 404 to user: Volume c1f532f4-cbd5-43b8-aff9-0ef8823ad81f could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:13:27.031941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-91a30d18-42d6-4c01-a19a-99e91a4ae58b tempest-VolumesGetTestJSON-1541111090 tempest-VolumesGetTestJSON-1541111090-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f" status: 404 len: 109 microversion: 2.1 time: 0.064176 Aug 10 23:13:27.040071 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 4/7] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:13:26 2022] GET /compute/v2.1/os-volumes/c1f532f4-cbd5-43b8-aff9-0ef8823ad81f => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:13:31.427932 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-747029361", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:31.734109 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] validate_networks() for [('aba1c323-0adb-4be7-b40f-f561499325a5', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:13:33.399788 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d98ff804-bc09-4cdf-bcd8-3fc84afe6f70 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Action: 'create', calling method: .version_select at 0x7fe841b9b310>, body: {"keypair": {"name": "tempest-keypair-1612192330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1CmnQ5IDfCX6ZPEbeYrxI1DjFWqdYGa9lLtq5dYc9u/08Er9skOq0zhsSRw5N4rcYDFyUcTZ73DUwphkMfPIjnTobRIRQ1D19nOMTOPVRBETmw29JkDV3AKfSoPpSC5w=="}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:33.545121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-d98ff804-bc09-4cdf-bcd8-3fc84afe6f70 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Getting quotas for project 830b226057d740ca85bbdde6c1a5dca8. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:13:33.559383 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-d98ff804-bc09-4cdf-bcd8-3fc84afe6f70 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Getting quotas for user 45dd5b35a039468d99ec0d393056c5af and project 830b226057d740ca85bbdde6c1a5dca8. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:13:33.804620 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d98ff804-bc09-4cdf-bcd8-3fc84afe6f70 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.281262 Aug 10 23:13:33.805510 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 5/8] 10.222.0.78 () {62 vars in 1200 bytes} [Wed Aug 10 23:13:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1283 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 23:13:34.426931 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b231d995-c962-4919-ad18-444a491b914f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: .version_select at 0x7fe841b6db80>, body: {"keypair": {"name": "tempest-keypair-255779325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnesSkfpL4VE0kyjOsRlf++NQhBSqS21S+ZzV18YD4kkc04OiFFYXjetkdn7TWm0yK3w9nfSZMTBIektfKsLqcCTsp1Njy78IfpkSjjBNDzYjAe3STpd+RnstVwUtwC2Q=="}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:34.493649 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-b231d995-c962-4919-ad18-444a491b914f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:13:34.506523 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-b231d995-c962-4919-ad18-444a491b914f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for user 22e92975af1d439f88e33cc494c88b1f and project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:13:34.674318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b231d995-c962-4919-ad18-444a491b914f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.866396 Aug 10 23:13:34.675007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 6/9] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 10 23:13:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:35.545255 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:13:35.545771 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:13:35.546144 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:13:35.546745 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:13:35.547325 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:13:35.596434 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.597186 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.599931 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.599931 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.602981 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.604192 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.700372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Getting quotas for project be0d52e189904e3c9971960d3ff4f58b. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:13:35.716497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Getting quotas for user ffb46379ef204df6bebd58f3bdb78ff6 and project be0d52e189904e3c9971960d3ff4f58b. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:13:35.748836 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:13:35.756413 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:13:36.012137 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b0bc39e1-0f37-4882-bc0a-e75a38fbbee9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.239081 Aug 10 23:13:36.013281 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 4/10] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:13:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 5249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:13:36.018906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-607c98d4-7ca0-4115-a367-41ad9c25743b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:36.019771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-607c98d4-7ca0-4115-a367-41ad9c25743b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:36.276575 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-607c98d4-7ca0-4115-a367-41ad9c25743b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:36.317816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-607c98d4-7ca0-4115-a367-41ad9c25743b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1221 microversion: 2.1 time: 0.304096 Aug 10 23:13:36.325302 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 7/11] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:36 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1221 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:36.566586 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-247897386", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:36.745728 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] validate_networks() for [('aba1c323-0adb-4be7-b40f-f561499325a5', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:13:37.277544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1943060062", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "networks": [{"uuid": "31125474-c5f6-4905-8853-a1f98cb82e5e"}]}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:37.433884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.network.neutron [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] validate_networks() for [('31125474-c5f6-4905-8853-a1f98cb82e5e', None, None, None, None, None)] {{(pid=121332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:13:38.264878 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:13:38.265457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:13:38.266322 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:13:38.266941 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:13:38.267597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:13:38.305892 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:38.307678 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:38.308311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:38.310476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:38.312817 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:38.313431 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:38.351812 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Getting quotas for project be0d52e189904e3c9971960d3ff4f58b. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:13:38.357557 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Getting quotas for user ffb46379ef204df6bebd58f3bdb78ff6 and project be0d52e189904e3c9971960d3ff4f58b. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:13:38.393058 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:13:38.395756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:13:38.562444 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1cac4a57-362c-45d3-984e-fa96a3e4765c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.000507 Aug 10 23:13:38.567507 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 5/12] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:13:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:13:38.585225 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dabb8d1a-68c2-496b-8996-1d7fb792ffa0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:38.588526 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dabb8d1a-68c2-496b-8996-1d7fb792ffa0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:38.823305 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-dabb8d1a-68c2-496b-8996-1d7fb792ffa0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:38.860670 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dabb8d1a-68c2-496b-8996-1d7fb792ffa0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1221 microversion: 2.1 time: 0.280257 Aug 10 23:13:38.860670 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 6/13] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:38 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1221 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:39.329554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Flavor limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:13:39.330053 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Image limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:13:39.330462 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Flavor pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:13:39.331073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Image pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:13:39.336659 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:13:39.366520 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:39.367364 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:39.368746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:39.372043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:39.376182 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:39.376871 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:39.458151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Getting quotas for project 78a0df50573341beb4cf1e2480ba6736. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:13:39.466100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Getting quotas for user c5f2e6ec64db4ba3b3db2ca564c26bed and project 78a0df50573341beb4cf1e2480ba6736. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:13:39.497670 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Going to run 1 instances... {{(pid=121332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:13:39.503792 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:13:39.707492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1263646918", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5706bed-5eba-416c-a716-3d6de0641407"}], "security_groups": [{"name": "tempest-securitygroup--1278120419"}], "key_name": "tempest-keypair-1612192330", "user_data": "}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:39.891688 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] validate_networks() for [('f5706bed-5eba-416c-a716-3d6de0641407', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:13:39.910476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9f49994f-4713-4d68-8ab7-32863d4d780d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.853318 Aug 10 23:13:39.913217 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 8/14] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:13:39.923457 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-bbc73b5c-190f-4300-bd5a-4977681d5417 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:39.924296 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bbc73b5c-190f-4300-bd5a-4977681d5417 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:40.299608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-bbc73b5c-190f-4300-bd5a-4977681d5417 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:40.308246 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-bbc73b5c-190f-4300-bd5a-4977681d5417 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1221 microversion: 2.1 time: 0.395213 Aug 10 23:13:40.308952 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 9/15] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:39 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1221 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:40.326515 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f5564e5b-bfe9-43b0-9648-b1802b441a2b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:40.328184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f5564e5b-bfe9-43b0-9648-b1802b441a2b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:40.434169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f5564e5b-bfe9-43b0-9648-b1802b441a2b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:40.450751 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f5564e5b-bfe9-43b0-9648-b1802b441a2b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1215 microversion: 2.1 time: 0.128356 Aug 10 23:13:40.455370 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 10/16] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:40 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:40.892222 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1151217916", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ce4c9a7-fd4e-4da4-add0-101e1cd65acd"}], "security_groups": [{"name": "tempest-securitygroup--1491123610"}], "key_name": "tempest-keypair-255779325", "user_data": "}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:40.923712 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:13:40.924338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:13:40.925084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:13:40.925640 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:13:40.926212 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:13:40.938976 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:40.939619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:40.940285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:40.941783 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:40.942117 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:40.942554 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:40.992552 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Getting quotas for project 830b226057d740ca85bbdde6c1a5dca8. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:13:40.999286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Getting quotas for user 45dd5b35a039468d99ec0d393056c5af and project 830b226057d740ca85bbdde6c1a5dca8. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:13:41.018527 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.network.neutron [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] validate_networks() for [('5ce4c9a7-fd4e-4da4-add0-101e1cd65acd', None, None, None, None, None)] {{(pid=121332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:13:41.047712 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:13:41.054555 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:13:41.353732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6b2a5820-d729-4396-b548-ad8e695c8854 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.691223 Aug 10 23:13:41.355764 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 7/17] 10.222.0.78 () {62 vars in 1188 bytes} [Wed Aug 10 23:13:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 10 23:13:41.376359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d41d32d0-7099-4203-ba9b-8c4d37155eea tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:41.377206 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d41d32d0-7099-4203-ba9b-8c4d37155eea tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:41.384247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d41d32d0-7099-4203-ba9b-8c4d37155eea tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:41.386040 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d41d32d0-7099-4203-ba9b-8c4d37155eea tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:41.386988 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d41d32d0-7099-4203-ba9b-8c4d37155eea tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.388017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d41d32d0-7099-4203-ba9b-8c4d37155eea tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:41.388485 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d41d32d0-7099-4203-ba9b-8c4d37155eea tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:41.389170 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d41d32d0-7099-4203-ba9b-8c4d37155eea tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.579542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d41d32d0-7099-4203-ba9b-8c4d37155eea tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:41.591342 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d41d32d0-7099-4203-ba9b-8c4d37155eea tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1225 microversion: 2.1 time: 0.234230 Aug 10 23:13:41.591929 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 8/18] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:41 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1225 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:41.596868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7c95a2e4-92c0-4660-8b3d-285be15243d9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:41.597475 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7c95a2e4-92c0-4660-8b3d-285be15243d9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:41.634270 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Flavor limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:13:41.634864 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Image limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:13:41.635238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Flavor pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:13:41.635648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Image pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:13:41.636067 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:13:41.654137 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:41.654881 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:41.655565 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.656325 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:41.656787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:41.657225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.668990 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7c95a2e4-92c0-4660-8b3d-285be15243d9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:41.676963 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7c95a2e4-92c0-4660-8b3d-285be15243d9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:41.677120 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:13:41.678521 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7c95a2e4-92c0-4660-8b3d-285be15243d9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:41.679705 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7c95a2e4-92c0-4660-8b3d-285be15243d9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1282 microversion: 2.20 time: 0.086715 Aug 10 23:13:41.680274 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 9/19] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:41 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:41.683465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for user 22e92975af1d439f88e33cc494c88b1f and project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:13:41.685808 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-37bbd6ef-e560-4a98-bcbe-6af0628a3329 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:41.685889 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-37bbd6ef-e560-4a98-bcbe-6af0628a3329 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:41.693468 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-37bbd6ef-e560-4a98-bcbe-6af0628a3329 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:41.693963 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-37bbd6ef-e560-4a98-bcbe-6af0628a3329 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:41.694392 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-37bbd6ef-e560-4a98-bcbe-6af0628a3329 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.695145 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-37bbd6ef-e560-4a98-bcbe-6af0628a3329 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:41.695610 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-37bbd6ef-e560-4a98-bcbe-6af0628a3329 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:41.696038 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-37bbd6ef-e560-4a98-bcbe-6af0628a3329 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.700613 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Going to run 1 instances... {{(pid=121332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:13:41.703108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:13:41.766983 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-37bbd6ef-e560-4a98-bcbe-6af0628a3329 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:41.775487 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-37bbd6ef-e560-4a98-bcbe-6af0628a3329 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1219 microversion: 2.1 time: 0.094160 Aug 10 23:13:41.776068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 10/20] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:41 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:41.999928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-48820a5e-defa-4d64-a3f7-ab2e0404de1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.116180 Aug 10 23:13:42.000582 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 11/21] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:13:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:13:42.011924 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2d963e81-7fd9-49e3-b945-6e70d921f7e9 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:42.012548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2d963e81-7fd9-49e3-b945-6e70d921f7e9 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:42.090942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2d963e81-7fd9-49e3-b945-6e70d921f7e9 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:42.107776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2d963e81-7fd9-49e3-b945-6e70d921f7e9 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1241 microversion: 2.1 time: 0.091346 Aug 10 23:13:42.107776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 11/22] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:42 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:42.613638 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-16983f90-018c-4473-a518-2b7eef79ed53 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:42.614575 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-16983f90-018c-4473-a518-2b7eef79ed53 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:42.624613 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-16983f90-018c-4473-a518-2b7eef79ed53 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:42.629169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-16983f90-018c-4473-a518-2b7eef79ed53 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:42.629169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-16983f90-018c-4473-a518-2b7eef79ed53 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:42.629169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-16983f90-018c-4473-a518-2b7eef79ed53 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:42.629169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-16983f90-018c-4473-a518-2b7eef79ed53 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:42.629546 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-16983f90-018c-4473-a518-2b7eef79ed53 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:42.704305 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d79b5d32-3455-49bf-b8c8-8bcfa8e4a64b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:42.708769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d79b5d32-3455-49bf-b8c8-8bcfa8e4a64b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:42.786790 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d79b5d32-3455-49bf-b8c8-8bcfa8e4a64b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:42.811824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-16983f90-018c-4473-a518-2b7eef79ed53 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:42.825337 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d79b5d32-3455-49bf-b8c8-8bcfa8e4a64b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:42.827378 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d79b5d32-3455-49bf-b8c8-8bcfa8e4a64b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:42.828720 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d79b5d32-3455-49bf-b8c8-8bcfa8e4a64b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1282 microversion: 2.20 time: 0.128719 Aug 10 23:13:42.829793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 12/23] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:42 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1282 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:42.840343 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-971b12f3-b019-425b-a140-c69e9290f1c4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:42.840343 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-971b12f3-b019-425b-a140-c69e9290f1c4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:42.844118 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-971b12f3-b019-425b-a140-c69e9290f1c4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:42.845857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-971b12f3-b019-425b-a140-c69e9290f1c4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:42.846706 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-971b12f3-b019-425b-a140-c69e9290f1c4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:42.847800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-971b12f3-b019-425b-a140-c69e9290f1c4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:42.848585 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-971b12f3-b019-425b-a140-c69e9290f1c4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:42.849250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-971b12f3-b019-425b-a140-c69e9290f1c4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:42.851559 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-16983f90-018c-4473-a518-2b7eef79ed53 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1225 microversion: 2.1 time: 0.238903 Aug 10 23:13:42.863452 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 12/24] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:42 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1225 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:42.949816 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-971b12f3-b019-425b-a140-c69e9290f1c4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:42.958079 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-971b12f3-b019-425b-a140-c69e9290f1c4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1219 microversion: 2.1 time: 0.126903 Aug 10 23:13:42.958990 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 13/25] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:42 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:43.122812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-849861ea-3d4b-4ae3-8890-6db81ba699c6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:43.123593 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-849861ea-3d4b-4ae3-8890-6db81ba699c6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:43.193052 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-849861ea-3d4b-4ae3-8890-6db81ba699c6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:43.209638 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-849861ea-3d4b-4ae3-8890-6db81ba699c6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1241 microversion: 2.1 time: 0.090757 Aug 10 23:13:43.210226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 13/26] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:43 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:43.856282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:43.856900 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:43.865069 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.874225 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.874225 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.874225 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.874225 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.874568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.877442 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f9a51518-7ce4-4ff1-92a5-1879eedfd787 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:43.878308 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f9a51518-7ce4-4ff1-92a5-1879eedfd787 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:43.893863 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f9a51518-7ce4-4ff1-92a5-1879eedfd787 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.897234 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f9a51518-7ce4-4ff1-92a5-1879eedfd787 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.901325 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f9a51518-7ce4-4ff1-92a5-1879eedfd787 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.901325 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f9a51518-7ce4-4ff1-92a5-1879eedfd787 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.901325 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f9a51518-7ce4-4ff1-92a5-1879eedfd787 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.901325 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f9a51518-7ce4-4ff1-92a5-1879eedfd787 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.952071 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:43.961158 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:43.963533 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:43.964678 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f8e51009-afdc-4e24-bbea-3a9f1dff6b01 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1278 microversion: 2.20 time: 0.112940 Aug 10 23:13:43.977495 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 14/27] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:43 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:43.983585 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2426bcfe-2630-4d9a-b3b3-82b3daf61e6b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:43.984214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2426bcfe-2630-4d9a-b3b3-82b3daf61e6b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:43.991331 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2426bcfe-2630-4d9a-b3b3-82b3daf61e6b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.991830 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2426bcfe-2630-4d9a-b3b3-82b3daf61e6b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.992516 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2426bcfe-2630-4d9a-b3b3-82b3daf61e6b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.993620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2426bcfe-2630-4d9a-b3b3-82b3daf61e6b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.994191 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2426bcfe-2630-4d9a-b3b3-82b3daf61e6b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.994631 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2426bcfe-2630-4d9a-b3b3-82b3daf61e6b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:44.012664 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f9a51518-7ce4-4ff1-92a5-1879eedfd787 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:44.020818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f9a51518-7ce4-4ff1-92a5-1879eedfd787 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1217 microversion: 2.1 time: 0.150907 Aug 10 23:13:44.021923 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 14/28] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:43 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:44.070456 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2426bcfe-2630-4d9a-b3b3-82b3daf61e6b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:44.078936 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2426bcfe-2630-4d9a-b3b3-82b3daf61e6b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1267 microversion: 2.1 time: 0.100269 Aug 10 23:13:44.079521 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 15/29] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:43 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:44.235687 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-92dc9e65-bcf6-49fa-9f08-797bc11e9fe8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:44.235687 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-92dc9e65-bcf6-49fa-9f08-797bc11e9fe8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:44.242220 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92dc9e65-bcf6-49fa-9f08-797bc11e9fe8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:44.242732 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92dc9e65-bcf6-49fa-9f08-797bc11e9fe8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:44.243179 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92dc9e65-bcf6-49fa-9f08-797bc11e9fe8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:44.244444 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92dc9e65-bcf6-49fa-9f08-797bc11e9fe8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:44.244872 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92dc9e65-bcf6-49fa-9f08-797bc11e9fe8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:44.245296 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92dc9e65-bcf6-49fa-9f08-797bc11e9fe8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:44.312195 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-92dc9e65-bcf6-49fa-9f08-797bc11e9fe8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:44.319555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-92dc9e65-bcf6-49fa-9f08-797bc11e9fe8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1237 microversion: 2.1 time: 0.092010 Aug 10 23:13:44.320129 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 15/30] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:44 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:44.992072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:44.993782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:45.003524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.004767 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.005603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.008112 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.008890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.009551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.050238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d56b0de7-420c-4c99-8f98-b30f04846ad5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:45.051052 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d56b0de7-420c-4c99-8f98-b30f04846ad5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:45.066024 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d56b0de7-420c-4c99-8f98-b30f04846ad5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.066024 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d56b0de7-420c-4c99-8f98-b30f04846ad5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.066490 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d56b0de7-420c-4c99-8f98-b30f04846ad5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.068064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d56b0de7-420c-4c99-8f98-b30f04846ad5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.071046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d56b0de7-420c-4c99-8f98-b30f04846ad5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.071517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d56b0de7-420c-4c99-8f98-b30f04846ad5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.227941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d56b0de7-420c-4c99-8f98-b30f04846ad5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:45.253757 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d56b0de7-420c-4c99-8f98-b30f04846ad5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1281 microversion: 2.1 time: 0.210161 Aug 10 23:13:45.255745 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 16/31] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:45 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1281 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:45.279306 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-86d49e1d-f3d7-41a8-a7e9-5a73fae4a48c tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:45.280184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-86d49e1d-f3d7-41a8-a7e9-5a73fae4a48c tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:45.287080 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86d49e1d-f3d7-41a8-a7e9-5a73fae4a48c tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.288126 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86d49e1d-f3d7-41a8-a7e9-5a73fae4a48c tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.288925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86d49e1d-f3d7-41a8-a7e9-5a73fae4a48c tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.290172 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86d49e1d-f3d7-41a8-a7e9-5a73fae4a48c tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.290812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86d49e1d-f3d7-41a8-a7e9-5a73fae4a48c tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.291608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86d49e1d-f3d7-41a8-a7e9-5a73fae4a48c tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.299243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:45.314594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:45.316535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:45.317672 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-51d45f68-6e83-4a03-a229-d87d289f8759 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1334 microversion: 2.20 time: 0.331646 Aug 10 23:13:45.318250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 16/32] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:44 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1334 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:45.345879 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c975826c-368a-4148-a24e-265bfcdf2700 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:45.346702 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c975826c-368a-4148-a24e-265bfcdf2700 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:45.364685 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c975826c-368a-4148-a24e-265bfcdf2700 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.364685 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c975826c-368a-4148-a24e-265bfcdf2700 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.364685 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c975826c-368a-4148-a24e-265bfcdf2700 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.364685 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c975826c-368a-4148-a24e-265bfcdf2700 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.365051 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c975826c-368a-4148-a24e-265bfcdf2700 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.365409 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c975826c-368a-4148-a24e-265bfcdf2700 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.602681 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-86d49e1d-f3d7-41a8-a7e9-5a73fae4a48c tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:45.611511 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-86d49e1d-f3d7-41a8-a7e9-5a73fae4a48c tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1275 microversion: 2.1 time: 0.354449 Aug 10 23:13:45.612366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 17/33] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:45 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1275 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:45.656891 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c975826c-368a-4148-a24e-265bfcdf2700 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:45.669331 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c975826c-368a-4148-a24e-265bfcdf2700 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1293 microversion: 2.1 time: 0.331564 Aug 10 23:13:45.669936 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 17/34] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:45 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1293 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:46.290568 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9e2a0579-bbe9-4cda-994e-80db22ea114d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:46.291429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9e2a0579-bbe9-4cda-994e-80db22ea114d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:46.300719 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9e2a0579-bbe9-4cda-994e-80db22ea114d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:46.303234 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9e2a0579-bbe9-4cda-994e-80db22ea114d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:46.303710 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9e2a0579-bbe9-4cda-994e-80db22ea114d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:46.305265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9e2a0579-bbe9-4cda-994e-80db22ea114d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:46.305773 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9e2a0579-bbe9-4cda-994e-80db22ea114d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:46.308241 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9e2a0579-bbe9-4cda-994e-80db22ea114d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:46.347348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:46.348681 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:46.356770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:46.357510 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:46.358018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:46.358920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:46.359454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:46.359958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:46.395627 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-9e2a0579-bbe9-4cda-994e-80db22ea114d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:46.406625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9e2a0579-bbe9-4cda-994e-80db22ea114d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1279 microversion: 2.1 time: 0.120471 Aug 10 23:13:46.408137 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 18/35] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:46 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:46.446854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:46.455024 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:46.456645 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:46.457856 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d22b0c57-9903-4e30-9611-7f737a768808 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1352 microversion: 2.20 time: 0.116222 Aug 10 23:13:46.458416 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 18/36] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:46 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:13:46.632562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4b5103db-5c89-496d-a61d-159871a4912b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:46.633191 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4b5103db-5c89-496d-a61d-159871a4912b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:46.639604 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b5103db-5c89-496d-a61d-159871a4912b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:46.640093 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b5103db-5c89-496d-a61d-159871a4912b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:46.640717 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b5103db-5c89-496d-a61d-159871a4912b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:46.641567 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b5103db-5c89-496d-a61d-159871a4912b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:46.642184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b5103db-5c89-496d-a61d-159871a4912b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:46.642796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b5103db-5c89-496d-a61d-159871a4912b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:46.693518 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4e189e5f-4b4a-4ed7-b5e7-618db02ad8b7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:46.694594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4e189e5f-4b4a-4ed7-b5e7-618db02ad8b7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:46.703558 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e189e5f-4b4a-4ed7-b5e7-618db02ad8b7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:46.708316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e189e5f-4b4a-4ed7-b5e7-618db02ad8b7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:46.708316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e189e5f-4b4a-4ed7-b5e7-618db02ad8b7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:46.708316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e189e5f-4b4a-4ed7-b5e7-618db02ad8b7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:46.708316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e189e5f-4b4a-4ed7-b5e7-618db02ad8b7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:46.708797 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e189e5f-4b4a-4ed7-b5e7-618db02ad8b7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:46.745952 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4b5103db-5c89-496d-a61d-159871a4912b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:46.756443 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4b5103db-5c89-496d-a61d-159871a4912b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1285 microversion: 2.1 time: 0.127699 Aug 10 23:13:46.757328 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 19/37] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:46 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:46.839082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4e189e5f-4b4a-4ed7-b5e7-618db02ad8b7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:46.847676 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4e189e5f-4b4a-4ed7-b5e7-618db02ad8b7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1301 microversion: 2.1 time: 0.159190 Aug 10 23:13:46.848688 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 19/38] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:46 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1301 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:47.433937 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-bbac8072-2840-4e55-8d23-c63f635dc462 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:47.434570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bbac8072-2840-4e55-8d23-c63f635dc462 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:47.440767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bbac8072-2840-4e55-8d23-c63f635dc462 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.441252 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bbac8072-2840-4e55-8d23-c63f635dc462 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.441691 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bbac8072-2840-4e55-8d23-c63f635dc462 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.442397 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bbac8072-2840-4e55-8d23-c63f635dc462 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.442898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bbac8072-2840-4e55-8d23-c63f635dc462 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.443331 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bbac8072-2840-4e55-8d23-c63f635dc462 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.481703 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:47.482341 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:47.489779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.490278 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.491232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.492258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.492748 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.493216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.568920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:47.581350 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:47.583294 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:47.585374 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0a501160-c46e-4ccf-80b5-fc480b6124dd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1352 microversion: 2.20 time: 0.107271 Aug 10 23:13:47.585952 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 20/39] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:47 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:47.635473 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-bbac8072-2840-4e55-8d23-c63f635dc462 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:47.642706 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-bbac8072-2840-4e55-8d23-c63f635dc462 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.213276 Aug 10 23:13:47.643271 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 20/40] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:47 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:47.784371 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1e9173a6-eba4-47c6-8ee5-6e31e24e78ef tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:47.785007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1e9173a6-eba4-47c6-8ee5-6e31e24e78ef tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:47.791046 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e9173a6-eba4-47c6-8ee5-6e31e24e78ef tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.792027 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e9173a6-eba4-47c6-8ee5-6e31e24e78ef tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.792525 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e9173a6-eba4-47c6-8ee5-6e31e24e78ef tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.793255 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e9173a6-eba4-47c6-8ee5-6e31e24e78ef tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.793775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e9173a6-eba4-47c6-8ee5-6e31e24e78ef tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.794193 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e9173a6-eba4-47c6-8ee5-6e31e24e78ef tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.860331 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1e9173a6-eba4-47c6-8ee5-6e31e24e78ef tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:47.869453 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-915a6379-4c13-4247-ac97-a046c421521d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:47.874769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1e9173a6-eba4-47c6-8ee5-6e31e24e78ef tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1285 microversion: 2.1 time: 0.090500 Aug 10 23:13:47.874888 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-915a6379-4c13-4247-ac97-a046c421521d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:47.874978 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 21/41] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:47 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:47.881559 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-915a6379-4c13-4247-ac97-a046c421521d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.882058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-915a6379-4c13-4247-ac97-a046c421521d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.882487 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-915a6379-4c13-4247-ac97-a046c421521d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.883219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-915a6379-4c13-4247-ac97-a046c421521d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.883676 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-915a6379-4c13-4247-ac97-a046c421521d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.884166 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-915a6379-4c13-4247-ac97-a046c421521d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.944847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-915a6379-4c13-4247-ac97-a046c421521d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:47.952240 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-915a6379-4c13-4247-ac97-a046c421521d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1301 microversion: 2.1 time: 0.087884 Aug 10 23:13:47.952805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 21/42] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:47 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:48.609045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:48.609966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:48.616293 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.616797 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.617251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.617992 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.618477 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.619057 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.664371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e41bf276-eb13-4e47-8cea-9ec2702c3168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:48.664986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e41bf276-eb13-4e47-8cea-9ec2702c3168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:48.671509 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e41bf276-eb13-4e47-8cea-9ec2702c3168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.672470 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e41bf276-eb13-4e47-8cea-9ec2702c3168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.672470 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e41bf276-eb13-4e47-8cea-9ec2702c3168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.673238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e41bf276-eb13-4e47-8cea-9ec2702c3168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.673866 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e41bf276-eb13-4e47-8cea-9ec2702c3168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.674292 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e41bf276-eb13-4e47-8cea-9ec2702c3168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.685423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:48.694397 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:48.695962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:48.697194 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ba179587-3109-4495-968e-d8b088156613 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1352 microversion: 2.20 time: 0.093464 Aug 10 23:13:48.698323 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 22/43] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:48 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:48.814682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e41bf276-eb13-4e47-8cea-9ec2702c3168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:48.822226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e41bf276-eb13-4e47-8cea-9ec2702c3168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.162398 Aug 10 23:13:48.823363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 22/44] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:48 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:48.892966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b161b90f-a68b-4ea2-8921-8460b370c4c0 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:48.893573 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b161b90f-a68b-4ea2-8921-8460b370c4c0 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:48.899854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b161b90f-a68b-4ea2-8921-8460b370c4c0 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.900372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b161b90f-a68b-4ea2-8921-8460b370c4c0 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.900887 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b161b90f-a68b-4ea2-8921-8460b370c4c0 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.901578 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b161b90f-a68b-4ea2-8921-8460b370c4c0 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.902499 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b161b90f-a68b-4ea2-8921-8460b370c4c0 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.903084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b161b90f-a68b-4ea2-8921-8460b370c4c0 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.973484 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a89726f5-36de-4511-b4a4-0ad96dfa3a1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:48.974197 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a89726f5-36de-4511-b4a4-0ad96dfa3a1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:48.980254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a89726f5-36de-4511-b4a4-0ad96dfa3a1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.981103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a89726f5-36de-4511-b4a4-0ad96dfa3a1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.981613 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a89726f5-36de-4511-b4a4-0ad96dfa3a1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.982474 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a89726f5-36de-4511-b4a4-0ad96dfa3a1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.983114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a89726f5-36de-4511-b4a4-0ad96dfa3a1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.983548 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a89726f5-36de-4511-b4a4-0ad96dfa3a1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.984523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b161b90f-a68b-4ea2-8921-8460b370c4c0 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:48.992857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b161b90f-a68b-4ea2-8921-8460b370c4c0 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1285 microversion: 2.1 time: 0.103906 Aug 10 23:13:48.997737 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 23/45] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:48 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:49.047910 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a89726f5-36de-4511-b4a4-0ad96dfa3a1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:49.055295 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a89726f5-36de-4511-b4a4-0ad96dfa3a1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1301 microversion: 2.1 time: 0.085850 Aug 10 23:13:49.055853 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 23/46] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:48 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:49.721869 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:49.723182 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:49.756102 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:49.759204 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:49.761513 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:49.765813 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:49.766292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:49.766944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:49.843971 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5517150b-309b-4d53-bcdc-96d0533be415 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:49.844696 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5517150b-309b-4d53-bcdc-96d0533be415 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:49.856333 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5517150b-309b-4d53-bcdc-96d0533be415 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:49.864631 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5517150b-309b-4d53-bcdc-96d0533be415 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:49.865778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5517150b-309b-4d53-bcdc-96d0533be415 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:49.867535 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5517150b-309b-4d53-bcdc-96d0533be415 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:49.895429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5517150b-309b-4d53-bcdc-96d0533be415 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:49.902636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5517150b-309b-4d53-bcdc-96d0533be415 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:50.029708 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:50.043073 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:50.045838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:50.047435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-98704a63-9a96-4161-87af-cb9cdb6abc6d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1352 microversion: 2.20 time: 0.330096 Aug 10 23:13:50.058802 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 24/47] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:49 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1352 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:50.061759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6ad68718-98f1-43b1-a27b-55b69a7ada45 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:50.065893 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6ad68718-98f1-43b1-a27b-55b69a7ada45 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:50.078847 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6ad68718-98f1-43b1-a27b-55b69a7ada45 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:50.082793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6ad68718-98f1-43b1-a27b-55b69a7ada45 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:50.085120 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6ad68718-98f1-43b1-a27b-55b69a7ada45 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:50.087521 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6ad68718-98f1-43b1-a27b-55b69a7ada45 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:50.096610 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6ad68718-98f1-43b1-a27b-55b69a7ada45 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:50.097044 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6ad68718-98f1-43b1-a27b-55b69a7ada45 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:50.407922 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5517150b-309b-4d53-bcdc-96d0533be415 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:50.416264 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6ad68718-98f1-43b1-a27b-55b69a7ada45 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:50.428128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6ad68718-98f1-43b1-a27b-55b69a7ada45 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1273 microversion: 2.1 time: 0.375345 Aug 10 23:13:50.434197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 25/48] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:50 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1273 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:50.461351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-10c037ea-f668-4b78-8569-682cec33a704 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:50.461994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-10c037ea-f668-4b78-8569-682cec33a704 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:50.472674 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5517150b-309b-4d53-bcdc-96d0533be415 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.629325 Aug 10 23:13:50.475007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 24/49] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:49 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:50.477087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10c037ea-f668-4b78-8569-682cec33a704 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:50.477580 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10c037ea-f668-4b78-8569-682cec33a704 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:50.486550 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10c037ea-f668-4b78-8569-682cec33a704 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:50.489388 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10c037ea-f668-4b78-8569-682cec33a704 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:50.490016 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10c037ea-f668-4b78-8569-682cec33a704 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:50.490615 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10c037ea-f668-4b78-8569-682cec33a704 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:50.541928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=100 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:50.808918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-10c037ea-f668-4b78-8569-682cec33a704 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:50.826591 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-10c037ea-f668-4b78-8569-682cec33a704 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1299 microversion: 2.1 time: 0.389912 Aug 10 23:13:50.836787 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 26/50] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:50 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1299 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:51.078089 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:51.078727 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:51.089174 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:51.105055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.107000 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.107606 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.108747 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.109456 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.110487 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.274546 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:51.287480 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:51.289271 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:51.296677 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-71f6b880-fb21-4cc9-ad60-b5caba060351 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1340 microversion: 2.20 time: 0.220641 Aug 10 23:13:51.297713 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:51 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1340 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:51.457094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4f01fd99-5527-48ae-872a-4e629cdbdf99 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:51.458168 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4f01fd99-5527-48ae-872a-4e629cdbdf99 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:51.461554 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=6 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:51.463654 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:51.468089 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4f01fd99-5527-48ae-872a-4e629cdbdf99 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.469129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4f01fd99-5527-48ae-872a-4e629cdbdf99 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.469571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4f01fd99-5527-48ae-872a-4e629cdbdf99 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.470303 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4f01fd99-5527-48ae-872a-4e629cdbdf99 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.471065 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4f01fd99-5527-48ae-872a-4e629cdbdf99 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.472661 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4f01fd99-5527-48ae-872a-4e629cdbdf99 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.497020 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4c8dce9c-3e67-4590-9c57-9c99f69a372f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:51.497810 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4c8dce9c-3e67-4590-9c57-9c99f69a372f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:51.505328 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c8dce9c-3e67-4590-9c57-9c99f69a372f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.510600 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c8dce9c-3e67-4590-9c57-9c99f69a372f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.511272 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c8dce9c-3e67-4590-9c57-9c99f69a372f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.512119 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c8dce9c-3e67-4590-9c57-9c99f69a372f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.516211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c8dce9c-3e67-4590-9c57-9c99f69a372f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.518451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c8dce9c-3e67-4590-9c57-9c99f69a372f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.668878 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=4 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:52.587796 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4f01fd99-5527-48ae-872a-4e629cdbdf99 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:52.597057 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4f01fd99-5527-48ae-872a-4e629cdbdf99 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 1.143899 Aug 10 23:13:52.597607 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 27/52] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:51 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:52.612503 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-cecbf488-4b35-4290-a73b-cdb5b3b321a1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:52.613122 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-cecbf488-4b35-4290-a73b-cdb5b3b321a1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:52.636094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cecbf488-4b35-4290-a73b-cdb5b3b321a1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:52.636094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cecbf488-4b35-4290-a73b-cdb5b3b321a1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:52.636094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cecbf488-4b35-4290-a73b-cdb5b3b321a1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:52.636094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cecbf488-4b35-4290-a73b-cdb5b3b321a1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:52.636450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cecbf488-4b35-4290-a73b-cdb5b3b321a1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:52.636450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cecbf488-4b35-4290-a73b-cdb5b3b321a1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:52.777052 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4c8dce9c-3e67-4590-9c57-9c99f69a372f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:52.786151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4c8dce9c-3e67-4590-9c57-9c99f69a372f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 1.293434 Aug 10 23:13:52.808891 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=26 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:52.811685 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 26/53] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:51 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:52.817438 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:52.830084 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:52.837171 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:52.837916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:52.841585 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:52.842646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:52.843333 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:52.844057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:52.984950 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cecbf488-4b35-4290-a73b-cdb5b3b321a1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:52.993159 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-cecbf488-4b35-4290-a73b-cdb5b3b321a1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1299 microversion: 2.1 time: 0.389412 Aug 10 23:13:53.007725 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 28/54] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:52 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1299 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:53.203367 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=28 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:53.221225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:53.232589 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:53.235797 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:53.237195 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-dc1835bc-c3e9-438e-844b-5acb42222774 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1340 microversion: 2.20 time: 0.426294 Aug 10 23:13:53.253301 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 27/55] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:52 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1340 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:53.512388 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-c111ead5-4c68-43a5-b828-5f49cbb054a9 req-769ad622-2f86-4b3d-a81e-a706a7997b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a85987-a755-456a-9d00-0992cbe4368a", "tag": "f1b4d3c9-dbce-4d0a-a2e7-1dfdd40931a0"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:53.533453 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-c111ead5-4c68-43a5-b828-5f49cbb054a9 req-769ad622-2f86-4b3d-a81e-a706a7997b69 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:53.534159 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-c111ead5-4c68-43a5-b828-5f49cbb054a9 req-769ad622-2f86-4b3d-a81e-a706a7997b69 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:53.534817 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-c111ead5-4c68-43a5-b828-5f49cbb054a9 req-769ad622-2f86-4b3d-a81e-a706a7997b69 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:53.591323 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-c111ead5-4c68-43a5-b828-5f49cbb054a9 req-769ad622-2f86-4b3d-a81e-a706a7997b69 service nova] Creating event network-changed:f1b4d3c9-dbce-4d0a-a2e7-1dfdd40931a0 for instance e3a85987-a755-456a-9d00-0992cbe4368a on hv-cinder-85144 Aug 10 23:13:53.594439 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-c111ead5-4c68-43a5-b828-5f49cbb054a9 req-769ad622-2f86-4b3d-a81e-a706a7997b69 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121333) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:13:53.595886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-c111ead5-4c68-43a5-b828-5f49cbb054a9 req-769ad622-2f86-4b3d-a81e-a706a7997b69 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121333) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:13:53.603862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c993c65-62e6-4c4e-b95f-dee929ba260a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:53.610160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c993c65-62e6-4c4e-b95f-dee929ba260a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:53.611051 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c993c65-62e6-4c4e-b95f-dee929ba260a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:53.612067 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c993c65-62e6-4c4e-b95f-dee929ba260a None None] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:53.612706 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c993c65-62e6-4c4e-b95f-dee929ba260a None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:53.613316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c993c65-62e6-4c4e-b95f-dee929ba260a None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:53.669358 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-43f9fd7e-0d88-49c7-ab17-89fba38d9fd4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:53.669358 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-43f9fd7e-0d88-49c7-ab17-89fba38d9fd4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:53.671324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.compute.rpcapi [None req-9c993c65-62e6-4c4e-b95f-dee929ba260a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 23:13:53.671623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-43f9fd7e-0d88-49c7-ab17-89fba38d9fd4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:53.671623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-43f9fd7e-0d88-49c7-ab17-89fba38d9fd4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:53.671623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-43f9fd7e-0d88-49c7-ab17-89fba38d9fd4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:53.671623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-43f9fd7e-0d88-49c7-ab17-89fba38d9fd4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:53.672139 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-43f9fd7e-0d88-49c7-ab17-89fba38d9fd4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:53.672139 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-43f9fd7e-0d88-49c7-ab17-89fba38d9fd4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:53.672304 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c993c65-62e6-4c4e-b95f-dee929ba260a None None] Releasing lock "compute-rpcapi-router" {{(pid=121333) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:13:53.694311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9c993c65-62e6-4c4e-b95f-dee929ba260a None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274704 Aug 10 23:13:53.695674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:53.823183 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ff04e469-4eef-4104-8427-f091e28e4167 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:53.823843 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ff04e469-4eef-4104-8427-f091e28e4167 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:53.831192 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ff04e469-4eef-4104-8427-f091e28e4167 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:53.831888 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ff04e469-4eef-4104-8427-f091e28e4167 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:53.832500 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ff04e469-4eef-4104-8427-f091e28e4167 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:53.833754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ff04e469-4eef-4104-8427-f091e28e4167 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:53.834370 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ff04e469-4eef-4104-8427-f091e28e4167 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:53.835245 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ff04e469-4eef-4104-8427-f091e28e4167 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:54.595099 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-43f9fd7e-0d88-49c7-ab17-89fba38d9fd4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:54.600443 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=100 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:54.608771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-43f9fd7e-0d88-49c7-ab17-89fba38d9fd4 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.979046 Aug 10 23:13:54.610141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 28/57] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:53 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:54.629225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4b057402-57e2-4925-8f32-f6b9d852ec41 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:54.631671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4b057402-57e2-4925-8f32-f6b9d852ec41 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:54.637823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b057402-57e2-4925-8f32-f6b9d852ec41 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:54.638508 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b057402-57e2-4925-8f32-f6b9d852ec41 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:54.638972 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b057402-57e2-4925-8f32-f6b9d852ec41 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:54.639667 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b057402-57e2-4925-8f32-f6b9d852ec41 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:54.640259 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b057402-57e2-4925-8f32-f6b9d852ec41 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:54.640682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b057402-57e2-4925-8f32-f6b9d852ec41 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:54.674239 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ff04e469-4eef-4104-8427-f091e28e4167 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:54.682491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ff04e469-4eef-4104-8427-f091e28e4167 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.864828 Aug 10 23:13:54.683299 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 30/58] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:53 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:54.697722 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:54.700791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:54.706386 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:54.707075 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:54.707675 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:54.708549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:54.709005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:54.709479 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:54.911140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4b057402-57e2-4925-8f32-f6b9d852ec41 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:54.919393 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4b057402-57e2-4925-8f32-f6b9d852ec41 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.307743 Aug 10 23:13:54.919967 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 29/59] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:54 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:54.996912 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:55.009581 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:55.012488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:55.013864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-518dbe30-7277-475a-af0c-9ca1e75838b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.329490 Aug 10 23:13:55.031159 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 31/60] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:54 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:55.113606 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-7d7739e3-17f6-49b7-b809-4ed0e554fe38 req-10ef03f1-561b-4827-bd3b-46b0ec82690a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7ea374-a02e-4bdc-a8ed-02453f7dcc66", "tag": "e7890e54-55df-4695-9a95-9f617e451cc1"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:55.125580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7d7739e3-17f6-49b7-b809-4ed0e554fe38 req-10ef03f1-561b-4827-bd3b-46b0ec82690a service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.126212 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7d7739e3-17f6-49b7-b809-4ed0e554fe38 req-10ef03f1-561b-4827-bd3b-46b0ec82690a service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.126538 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7d7739e3-17f6-49b7-b809-4ed0e554fe38 req-10ef03f1-561b-4827-bd3b-46b0ec82690a service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.154070 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-7d7739e3-17f6-49b7-b809-4ed0e554fe38 req-10ef03f1-561b-4827-bd3b-46b0ec82690a service nova] Creating event network-changed:e7890e54-55df-4695-9a95-9f617e451cc1 for instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 on hv-cinder-85144 Aug 10 23:13:55.157148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7d7739e3-17f6-49b7-b809-4ed0e554fe38 req-10ef03f1-561b-4827-bd3b-46b0ec82690a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:13:55.157148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7d7739e3-17f6-49b7-b809-4ed0e554fe38 req-10ef03f1-561b-4827-bd3b-46b0ec82690a service nova] Acquired lock "compute-rpcapi-router" {{(pid=121332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:13:55.157148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2c63e3a4-1383-4ac3-8cfb-b34286b66305 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.157148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2c63e3a4-1383-4ac3-8cfb-b34286b66305 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.157148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2c63e3a4-1383-4ac3-8cfb-b34286b66305 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.157628 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2c63e3a4-1383-4ac3-8cfb-b34286b66305 None None] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.158019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2c63e3a4-1383-4ac3-8cfb-b34286b66305 None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.158434 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2c63e3a4-1383-4ac3-8cfb-b34286b66305 None None] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.167412 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.compute.rpcapi [None req-2c63e3a4-1383-4ac3-8cfb-b34286b66305 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 23:13:55.168268 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2c63e3a4-1383-4ac3-8cfb-b34286b66305 None None] Releasing lock "compute-rpcapi-router" {{(pid=121332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:13:55.185009 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2c63e3a4-1383-4ac3-8cfb-b34286b66305 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131924 Aug 10 23:13:55.185981 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 30/61] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:55.633406 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4c3b27c4-5598-46ae-91d2-228697486602 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:55.633945 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4c3b27c4-5598-46ae-91d2-228697486602 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:55.639913 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4c3b27c4-5598-46ae-91d2-228697486602 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.648653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4c3b27c4-5598-46ae-91d2-228697486602 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.648653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4c3b27c4-5598-46ae-91d2-228697486602 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.648653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4c3b27c4-5598-46ae-91d2-228697486602 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.648653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4c3b27c4-5598-46ae-91d2-228697486602 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.648990 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4c3b27c4-5598-46ae-91d2-228697486602 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.704167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-75696c26-4581-48bd-aba9-6471b59412d2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:55.714216 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-75696c26-4581-48bd-aba9-6471b59412d2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:55.715009 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75696c26-4581-48bd-aba9-6471b59412d2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.715569 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75696c26-4581-48bd-aba9-6471b59412d2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.716263 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75696c26-4581-48bd-aba9-6471b59412d2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.717533 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75696c26-4581-48bd-aba9-6471b59412d2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.718209 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75696c26-4581-48bd-aba9-6471b59412d2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.718916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75696c26-4581-48bd-aba9-6471b59412d2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.995237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4c3b27c4-5598-46ae-91d2-228697486602 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:56.003280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4c3b27c4-5598-46ae-91d2-228697486602 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.373742 Aug 10 23:13:56.003851 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 32/62] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:55 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:56.008658 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-e521a5a8-513a-4ac4-8023-73543d06c446 req-0e1533d5-8ae3-431b-84b9-e93085bd7fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae8526a-d85b-4176-a4b8-938d4617b7a3", "tag": "e427d004-9e4c-4ac6-a10d-f49430b10c39"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:56.018600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-e521a5a8-513a-4ac4-8023-73543d06c446 req-0e1533d5-8ae3-431b-84b9-e93085bd7fd5 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:56.019452 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-75696c26-4581-48bd-aba9-6471b59412d2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:56.019780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-e521a5a8-513a-4ac4-8023-73543d06c446 req-0e1533d5-8ae3-431b-84b9-e93085bd7fd5 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:56.020222 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-e521a5a8-513a-4ac4-8023-73543d06c446 req-0e1533d5-8ae3-431b-84b9-e93085bd7fd5 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:56.028029 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-75696c26-4581-48bd-aba9-6471b59412d2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.328045 Aug 10 23:13:56.029160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 31/63] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:55 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:56.031779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-e521a5a8-513a-4ac4-8023-73543d06c446 req-0e1533d5-8ae3-431b-84b9-e93085bd7fd5 service nova] Creating event network-changed:e427d004-9e4c-4ac6-a10d-f49430b10c39 for instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 on hv-cinder-85144 Aug 10 23:13:56.034588 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-28ec5b0b-95c5-46fc-b934-2c8a9849c9f4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:56.035378 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-28ec5b0b-95c5-46fc-b934-2c8a9849c9f4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:56.043139 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28ec5b0b-95c5-46fc-b934-2c8a9849c9f4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:56.043340 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-e521a5a8-513a-4ac4-8023-73543d06c446 req-0e1533d5-8ae3-431b-84b9-e93085bd7fd5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037608 Aug 10 23:13:56.043751 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28ec5b0b-95c5-46fc-b934-2c8a9849c9f4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:56.043884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 33/64] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:56.044461 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28ec5b0b-95c5-46fc-b934-2c8a9849c9f4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:56.045324 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28ec5b0b-95c5-46fc-b934-2c8a9849c9f4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:56.045940 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28ec5b0b-95c5-46fc-b934-2c8a9849c9f4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:56.046362 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28ec5b0b-95c5-46fc-b934-2c8a9849c9f4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:56.052257 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:56.053079 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:56.060576 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:56.061105 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:56.061538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:56.062280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:56.062982 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:56.063473 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:56.243196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-28ec5b0b-95c5-46fc-b934-2c8a9849c9f4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:56.257891 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-28ec5b0b-95c5-46fc-b934-2c8a9849c9f4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.227323 Aug 10 23:13:56.258641 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 32/65] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:56 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:56.260202 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:56.268493 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:56.269923 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:56.271076 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-bfacc7a0-7bfe-4afd-85e8-2474999b1237 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.222881 Aug 10 23:13:56.275206 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:56 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:57.023617 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-835cd4db-9b3f-4ca5-a230-12058eef0728 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:57.024266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-835cd4db-9b3f-4ca5-a230-12058eef0728 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:57.030307 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-835cd4db-9b3f-4ca5-a230-12058eef0728 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:57.031037 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-835cd4db-9b3f-4ca5-a230-12058eef0728 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:57.031471 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-835cd4db-9b3f-4ca5-a230-12058eef0728 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.032166 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-835cd4db-9b3f-4ca5-a230-12058eef0728 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:57.032618 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-835cd4db-9b3f-4ca5-a230-12058eef0728 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:57.033040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-835cd4db-9b3f-4ca5-a230-12058eef0728 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.050373 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ad9e5333-7186-46a3-8520-c4f8989fa19f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:57.051021 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ad9e5333-7186-46a3-8520-c4f8989fa19f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:57.057720 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ad9e5333-7186-46a3-8520-c4f8989fa19f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:57.058285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ad9e5333-7186-46a3-8520-c4f8989fa19f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:57.059299 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ad9e5333-7186-46a3-8520-c4f8989fa19f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.060688 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ad9e5333-7186-46a3-8520-c4f8989fa19f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:57.061224 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ad9e5333-7186-46a3-8520-c4f8989fa19f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:57.061720 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ad9e5333-7186-46a3-8520-c4f8989fa19f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.234227 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-835cd4db-9b3f-4ca5-a230-12058eef0728 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:57.241974 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-835cd4db-9b3f-4ca5-a230-12058eef0728 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.222146 Aug 10 23:13:57.254802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 33/67] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:57 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:57.255135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ad9e5333-7186-46a3-8520-c4f8989fa19f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:57.255135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ad9e5333-7186-46a3-8520-c4f8989fa19f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.207868 Aug 10 23:13:57.261123 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 35/68] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:57 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:57.279067 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6dd1c300-e127-418e-9d0d-80f2485fb12c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:57.279794 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6dd1c300-e127-418e-9d0d-80f2485fb12c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:57.285917 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6dd1c300-e127-418e-9d0d-80f2485fb12c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:57.286403 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6dd1c300-e127-418e-9d0d-80f2485fb12c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:57.286883 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6dd1c300-e127-418e-9d0d-80f2485fb12c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.287585 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6dd1c300-e127-418e-9d0d-80f2485fb12c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:57.288043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6dd1c300-e127-418e-9d0d-80f2485fb12c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:57.288477 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6dd1c300-e127-418e-9d0d-80f2485fb12c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.297762 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:57.298480 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:57.307908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:57.308639 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:57.309083 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.309790 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:57.310253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:57.310700 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.500580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6dd1c300-e127-418e-9d0d-80f2485fb12c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:57.511832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6dd1c300-e127-418e-9d0d-80f2485fb12c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.236488 Aug 10 23:13:57.513759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 34/69] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:57 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:57.515603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:57.525222 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:57.528036 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:57.529614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-830645a1-1ee5-4fb2-8878-b27916f02271 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.235728 Aug 10 23:13:57.530343 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:57 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:13:58.268393 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a8797e0d-67a3-4d3e-878e-653d4437a180 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:58.269042 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a8797e0d-67a3-4d3e-878e-653d4437a180 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:58.275266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8797e0d-67a3-4d3e-878e-653d4437a180 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.276419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8797e0d-67a3-4d3e-878e-653d4437a180 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.277057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8797e0d-67a3-4d3e-878e-653d4437a180 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.277901 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8797e0d-67a3-4d3e-878e-653d4437a180 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.278316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1c1a1575-a6eb-4442-8b0c-4b81be0671d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:58.278794 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8797e0d-67a3-4d3e-878e-653d4437a180 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.279064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8797e0d-67a3-4d3e-878e-653d4437a180 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.279777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1c1a1575-a6eb-4442-8b0c-4b81be0671d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:58.285828 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c1a1575-a6eb-4442-8b0c-4b81be0671d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.286324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c1a1575-a6eb-4442-8b0c-4b81be0671d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.286776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c1a1575-a6eb-4442-8b0c-4b81be0671d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.287588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c1a1575-a6eb-4442-8b0c-4b81be0671d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.288045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c1a1575-a6eb-4442-8b0c-4b81be0671d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.288475 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c1a1575-a6eb-4442-8b0c-4b81be0671d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.481304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a8797e0d-67a3-4d3e-878e-653d4437a180 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:58.485614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1c1a1575-a6eb-4442-8b0c-4b81be0671d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:58.491643 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a8797e0d-67a3-4d3e-878e-653d4437a180 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.226808 Aug 10 23:13:58.495112 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 35/71] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:58 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:58.495407 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1c1a1575-a6eb-4442-8b0c-4b81be0671d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.221716 Aug 10 23:13:58.496243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 37/72] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:58 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:58.547881 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ef69f9eb-6e5f-445e-8ba1-597e9abae678 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:58.549699 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ef69f9eb-6e5f-445e-8ba1-597e9abae678 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:58.555411 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef69f9eb-6e5f-445e-8ba1-597e9abae678 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.555711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef69f9eb-6e5f-445e-8ba1-597e9abae678 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.556147 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef69f9eb-6e5f-445e-8ba1-597e9abae678 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.557513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef69f9eb-6e5f-445e-8ba1-597e9abae678 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.557957 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef69f9eb-6e5f-445e-8ba1-597e9abae678 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.558374 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:58.558545 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef69f9eb-6e5f-445e-8ba1-597e9abae678 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.559161 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:58.566582 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.567337 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.567940 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.568707 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.569226 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.569719 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.769859 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:58.782140 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:58.788820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:58.792809 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7b20acad-e955-4f5c-8a01-c690f8a11cb8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.240547 Aug 10 23:13:58.794630 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 38/73] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:58 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:13:58.796943 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ef69f9eb-6e5f-445e-8ba1-597e9abae678 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:58.810245 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ef69f9eb-6e5f-445e-8ba1-597e9abae678 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.263923 Aug 10 23:13:58.810956 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 36/74] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:58 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:59.516149 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-41efeb26-6044-495f-8665-6923792ffe83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:59.516788 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-39a2f544-000c-4ea3-ab95-ffe850fb70b3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:59.517177 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-41efeb26-6044-495f-8665-6923792ffe83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:59.517308 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-39a2f544-000c-4ea3-ab95-ffe850fb70b3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:59.523946 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-39a2f544-000c-4ea3-ab95-ffe850fb70b3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.524436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-39a2f544-000c-4ea3-ab95-ffe850fb70b3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.524891 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-39a2f544-000c-4ea3-ab95-ffe850fb70b3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.525390 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-41efeb26-6044-495f-8665-6923792ffe83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.525570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-39a2f544-000c-4ea3-ab95-ffe850fb70b3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.526025 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-39a2f544-000c-4ea3-ab95-ffe850fb70b3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.526139 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-41efeb26-6044-495f-8665-6923792ffe83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.526448 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-39a2f544-000c-4ea3-ab95-ffe850fb70b3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.526869 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-41efeb26-6044-495f-8665-6923792ffe83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.527525 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-41efeb26-6044-495f-8665-6923792ffe83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.527990 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-41efeb26-6044-495f-8665-6923792ffe83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.528955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-41efeb26-6044-495f-8665-6923792ffe83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.733271 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-41efeb26-6044-495f-8665-6923792ffe83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:59.741817 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-41efeb26-6044-495f-8665-6923792ffe83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.229369 Aug 10 23:13:59.745430 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 39/75] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:59 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:59.749874 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-39a2f544-000c-4ea3-ab95-ffe850fb70b3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:59.756506 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-39a2f544-000c-4ea3-ab95-ffe850fb70b3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.243617 Aug 10 23:13:59.757069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 37/76] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:59 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:59.826190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:59.844085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:59.844264 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5451f36a-dcb7-4c9b-94ea-d1df0726a42d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:59.844264 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5451f36a-dcb7-4c9b-94ea-d1df0726a42d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:59.844457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.844457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.844457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.844457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.844770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.844770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.844916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5451f36a-dcb7-4c9b-94ea-d1df0726a42d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.844916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5451f36a-dcb7-4c9b-94ea-d1df0726a42d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.844916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5451f36a-dcb7-4c9b-94ea-d1df0726a42d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.844916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5451f36a-dcb7-4c9b-94ea-d1df0726a42d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.845226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5451f36a-dcb7-4c9b-94ea-d1df0726a42d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.845226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5451f36a-dcb7-4c9b-94ea-d1df0726a42d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.058044 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:00.067492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5451f36a-dcb7-4c9b-94ea-d1df0726a42d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:00.075085 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5451f36a-dcb7-4c9b-94ea-d1df0726a42d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.247484 Aug 10 23:14:00.075807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 38/77] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:59 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:00.082406 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:00.082406 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:00.085531 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e663844d-b5c1-45aa-b74c-a9d39f7363d6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.264802 Aug 10 23:14:00.086766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 40/78] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:13:59 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:00.764818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-11fb222e-c48a-47b2-bb8c-dc266368f249 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:00.765505 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-11fb222e-c48a-47b2-bb8c-dc266368f249 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:00.774327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-11fb222e-c48a-47b2-bb8c-dc266368f249 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.774931 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-11fb222e-c48a-47b2-bb8c-dc266368f249 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.775427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-11fb222e-c48a-47b2-bb8c-dc266368f249 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.776140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-11fb222e-c48a-47b2-bb8c-dc266368f249 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.776721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-11fb222e-c48a-47b2-bb8c-dc266368f249 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.777413 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-11fb222e-c48a-47b2-bb8c-dc266368f249 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.778593 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dd832d81-e21d-497f-928e-bf931d1bb576 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:00.779891 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dd832d81-e21d-497f-928e-bf931d1bb576 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:00.788084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd832d81-e21d-497f-928e-bf931d1bb576 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.789095 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd832d81-e21d-497f-928e-bf931d1bb576 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.789711 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd832d81-e21d-497f-928e-bf931d1bb576 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.796432 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd832d81-e21d-497f-928e-bf931d1bb576 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.797280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd832d81-e21d-497f-928e-bf931d1bb576 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.797880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd832d81-e21d-497f-928e-bf931d1bb576 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:01.007055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-11fb222e-c48a-47b2-bb8c-dc266368f249 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:01.015569 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-11fb222e-c48a-47b2-bb8c-dc266368f249 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.255964 Aug 10 23:14:01.030160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-dd832d81-e21d-497f-928e-bf931d1bb576 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:01.030376 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 39/79] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:00 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:01.032693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dd832d81-e21d-497f-928e-bf931d1bb576 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.259011 Aug 10 23:14:01.033384 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 41/80] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:00 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:01.098869 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d2028c40-945a-448b-a60c-52a531fb4639 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:01.100324 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d2028c40-945a-448b-a60c-52a531fb4639 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:01.120601 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:01.121542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:01.127955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d2028c40-945a-448b-a60c-52a531fb4639 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:01.129976 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:01.130986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d2028c40-945a-448b-a60c-52a531fb4639 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:01.132306 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d2028c40-945a-448b-a60c-52a531fb4639 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:01.133058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d2028c40-945a-448b-a60c-52a531fb4639 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:01.133510 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d2028c40-945a-448b-a60c-52a531fb4639 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:01.133933 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d2028c40-945a-448b-a60c-52a531fb4639 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:01.136142 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:01.136577 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:01.139128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:01.139793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:01.142072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:01.483364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:01.508015 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:01.513633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:01.516943 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6b94d654-be79-4481-b2e2-5bd9c40b63f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.406544 Aug 10 23:14:01.518848 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 42/81] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:01 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:01.551594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d2028c40-945a-448b-a60c-52a531fb4639 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:01.561619 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d2028c40-945a-448b-a60c-52a531fb4639 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.468733 Aug 10 23:14:01.576632 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 40/82] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:01 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:02.041893 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-886fcbb5-2cd5-4e46-8a2e-fbb1335fb19a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:02.042604 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-886fcbb5-2cd5-4e46-8a2e-fbb1335fb19a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:02.051372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-886fcbb5-2cd5-4e46-8a2e-fbb1335fb19a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:02.051869 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-886fcbb5-2cd5-4e46-8a2e-fbb1335fb19a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:02.052311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-886fcbb5-2cd5-4e46-8a2e-fbb1335fb19a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:02.053029 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-886fcbb5-2cd5-4e46-8a2e-fbb1335fb19a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:02.053492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-886fcbb5-2cd5-4e46-8a2e-fbb1335fb19a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:02.053672 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d921d4f2-e369-48d8-ae2c-0d7e3f7bb265 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:02.054164 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-886fcbb5-2cd5-4e46-8a2e-fbb1335fb19a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:02.054953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d921d4f2-e369-48d8-ae2c-0d7e3f7bb265 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:02.062151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d921d4f2-e369-48d8-ae2c-0d7e3f7bb265 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:02.062886 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d921d4f2-e369-48d8-ae2c-0d7e3f7bb265 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:02.063480 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d921d4f2-e369-48d8-ae2c-0d7e3f7bb265 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:02.064344 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d921d4f2-e369-48d8-ae2c-0d7e3f7bb265 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:02.064968 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d921d4f2-e369-48d8-ae2c-0d7e3f7bb265 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:02.065563 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d921d4f2-e369-48d8-ae2c-0d7e3f7bb265 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:02.252789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-886fcbb5-2cd5-4e46-8a2e-fbb1335fb19a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:02.260241 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d921d4f2-e369-48d8-ae2c-0d7e3f7bb265 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:02.260414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-886fcbb5-2cd5-4e46-8a2e-fbb1335fb19a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.222974 Aug 10 23:14:02.260999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 43/83] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:02 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:02.269767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d921d4f2-e369-48d8-ae2c-0d7e3f7bb265 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.220083 Aug 10 23:14:02.270452 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 41/84] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:02 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:02.544205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:02.544793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:02.552825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:02.553328 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:02.553770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:02.554642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:02.555863 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:02.556329 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:02.561676 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=100 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:02.587039 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-627074e5-6315-4148-a0a9-bd2c0a98cf31 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:02.588707 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-627074e5-6315-4148-a0a9-bd2c0a98cf31 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:02.606825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-627074e5-6315-4148-a0a9-bd2c0a98cf31 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:02.606825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-627074e5-6315-4148-a0a9-bd2c0a98cf31 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:02.606825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-627074e5-6315-4148-a0a9-bd2c0a98cf31 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:02.606825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-627074e5-6315-4148-a0a9-bd2c0a98cf31 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:02.607165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-627074e5-6315-4148-a0a9-bd2c0a98cf31 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:02.607165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-627074e5-6315-4148-a0a9-bd2c0a98cf31 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:02.797391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:02.808820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:02.810558 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:02.812117 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-60fc34d1-01b6-4546-b1ad-d81be0bcb993 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.272685 Aug 10 23:14:02.813248 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 44/85] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:02 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:02.833653 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-627074e5-6315-4148-a0a9-bd2c0a98cf31 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:02.874089 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-627074e5-6315-4148-a0a9-bd2c0a98cf31 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.260276 Aug 10 23:14:02.874089 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 42/86] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:02 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:03.283800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-88ef055a-1bc0-44e1-b469-9adb7ffc5bd4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:03.284515 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-88ef055a-1bc0-44e1-b469-9adb7ffc5bd4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:03.291999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88ef055a-1bc0-44e1-b469-9adb7ffc5bd4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.292630 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88ef055a-1bc0-44e1-b469-9adb7ffc5bd4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.293142 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88ef055a-1bc0-44e1-b469-9adb7ffc5bd4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.293831 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d813fc56-2652-4466-93f8-75896225ce2d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:03.294318 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88ef055a-1bc0-44e1-b469-9adb7ffc5bd4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.294451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d813fc56-2652-4466-93f8-75896225ce2d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:03.294552 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88ef055a-1bc0-44e1-b469-9adb7ffc5bd4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.295090 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88ef055a-1bc0-44e1-b469-9adb7ffc5bd4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.304259 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d813fc56-2652-4466-93f8-75896225ce2d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.304755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d813fc56-2652-4466-93f8-75896225ce2d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.305577 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d813fc56-2652-4466-93f8-75896225ce2d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.305916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d813fc56-2652-4466-93f8-75896225ce2d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.306370 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d813fc56-2652-4466-93f8-75896225ce2d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.307434 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d813fc56-2652-4466-93f8-75896225ce2d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.548103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-88ef055a-1bc0-44e1-b469-9adb7ffc5bd4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:03.560911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-88ef055a-1bc0-44e1-b469-9adb7ffc5bd4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.278581 Aug 10 23:14:03.561532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 45/87] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:03 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:03.578037 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d813fc56-2652-4466-93f8-75896225ce2d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:03.585845 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d813fc56-2652-4466-93f8-75896225ce2d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.297548 Aug 10 23:14:03.598194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 43/88] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:03 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:03.836578 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:03.847469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:03.847469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:03.847469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.847469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.848028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.861632 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.862481 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.862960 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.889824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-714abddf-3ad7-4a71-a50c-7f48abe4dc0d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:03.896855 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-714abddf-3ad7-4a71-a50c-7f48abe4dc0d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:03.906696 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-714abddf-3ad7-4a71-a50c-7f48abe4dc0d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.907498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-714abddf-3ad7-4a71-a50c-7f48abe4dc0d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.908389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-714abddf-3ad7-4a71-a50c-7f48abe4dc0d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.909192 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-714abddf-3ad7-4a71-a50c-7f48abe4dc0d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.909785 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-714abddf-3ad7-4a71-a50c-7f48abe4dc0d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.910436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-714abddf-3ad7-4a71-a50c-7f48abe4dc0d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.158478 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-714abddf-3ad7-4a71-a50c-7f48abe4dc0d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:04.163104 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:04.168218 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-714abddf-3ad7-4a71-a50c-7f48abe4dc0d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.282483 Aug 10 23:14:04.168798 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 44/89] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:03 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:04.186793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:04.186793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:04.186793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b378c588-eb04-4cd9-91bd-e14332e99367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.354433 Aug 10 23:14:04.187236 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 46/90] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:03 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:04.581858 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e758a09d-d144-4c91-a1fb-1eab4dd306b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:04.582466 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e758a09d-d144-4c91-a1fb-1eab4dd306b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:04.598347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e758a09d-d144-4c91-a1fb-1eab4dd306b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.599144 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e758a09d-d144-4c91-a1fb-1eab4dd306b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.599571 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e758a09d-d144-4c91-a1fb-1eab4dd306b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.600584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e758a09d-d144-4c91-a1fb-1eab4dd306b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.601085 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e758a09d-d144-4c91-a1fb-1eab4dd306b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.601509 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e758a09d-d144-4c91-a1fb-1eab4dd306b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.609402 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8e6f096c-e070-4c9d-8ad1-ae1373934781 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:04.610051 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8e6f096c-e070-4c9d-8ad1-ae1373934781 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:04.621149 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e6f096c-e070-4c9d-8ad1-ae1373934781 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.623868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e6f096c-e070-4c9d-8ad1-ae1373934781 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.623868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e6f096c-e070-4c9d-8ad1-ae1373934781 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.623868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e6f096c-e070-4c9d-8ad1-ae1373934781 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.623868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e6f096c-e070-4c9d-8ad1-ae1373934781 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.624181 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e6f096c-e070-4c9d-8ad1-ae1373934781 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.875978 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e758a09d-d144-4c91-a1fb-1eab4dd306b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:04.879848 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=100 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:04.887241 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e758a09d-d144-4c91-a1fb-1eab4dd306b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.309079 Aug 10 23:14:04.888533 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 45/91] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:04 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:04.890921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8e6f096c-e070-4c9d-8ad1-ae1373934781 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:04.898556 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8e6f096c-e070-4c9d-8ad1-ae1373934781 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.292938 Aug 10 23:14:04.899160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 47/92] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:04 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:05.250224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d1733763-5fe7-447a-a970-c19f66ac7c1c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:05.250224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d1733763-5fe7-447a-a970-c19f66ac7c1c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:05.250224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:05.250224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d1733763-5fe7-447a-a970-c19f66ac7c1c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.250224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d1733763-5fe7-447a-a970-c19f66ac7c1c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.250724 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d1733763-5fe7-447a-a970-c19f66ac7c1c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.250724 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d1733763-5fe7-447a-a970-c19f66ac7c1c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.250724 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d1733763-5fe7-447a-a970-c19f66ac7c1c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.250724 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d1733763-5fe7-447a-a970-c19f66ac7c1c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.250984 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:05.250984 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:05.250984 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.250984 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.251268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.251268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.251268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.251268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.484768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d1733763-5fe7-447a-a970-c19f66ac7c1c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:05.497459 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:05.499529 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d1733763-5fe7-447a-a970-c19f66ac7c1c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.297837 Aug 10 23:14:05.501142 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 46/93] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:05 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:05.508647 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:05.511034 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:05.512151 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5a9c9bfc-2109-4d76-a04f-a84c13edecd8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.299150 Aug 10 23:14:05.514149 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 48/94] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:05 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:05.918288 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d728a505-b83b-4270-a453-ee36aff9dbc9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:05.918998 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d728a505-b83b-4270-a453-ee36aff9dbc9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:05.919531 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3272b098-4c19-48c4-99f5-9743f0ca83af tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:05.920310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3272b098-4c19-48c4-99f5-9743f0ca83af tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:05.925201 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d728a505-b83b-4270-a453-ee36aff9dbc9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.925746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d728a505-b83b-4270-a453-ee36aff9dbc9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.926042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3272b098-4c19-48c4-99f5-9743f0ca83af tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.926309 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d728a505-b83b-4270-a453-ee36aff9dbc9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.926520 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3272b098-4c19-48c4-99f5-9743f0ca83af tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.927001 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3272b098-4c19-48c4-99f5-9743f0ca83af tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.927268 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d728a505-b83b-4270-a453-ee36aff9dbc9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.927666 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d728a505-b83b-4270-a453-ee36aff9dbc9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.927798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3272b098-4c19-48c4-99f5-9743f0ca83af tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.928086 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d728a505-b83b-4270-a453-ee36aff9dbc9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.928207 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3272b098-4c19-48c4-99f5-9743f0ca83af tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.928538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3272b098-4c19-48c4-99f5-9743f0ca83af tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:06.123179 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d728a505-b83b-4270-a453-ee36aff9dbc9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:06.131648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d728a505-b83b-4270-a453-ee36aff9dbc9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.218658 Aug 10 23:14:06.132508 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 47/95] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:05 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:06.134197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3272b098-4c19-48c4-99f5-9743f0ca83af tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:06.145563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3272b098-4c19-48c4-99f5-9743f0ca83af tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.229852 Aug 10 23:14:06.146674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 49/96] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:05 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:06.523254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-76936f1f-62a7-443c-849c-984b60e36349 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:06.524734 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-76936f1f-62a7-443c-849c-984b60e36349 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:06.530990 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76936f1f-62a7-443c-849c-984b60e36349 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:06.531478 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76936f1f-62a7-443c-849c-984b60e36349 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:06.531914 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76936f1f-62a7-443c-849c-984b60e36349 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:06.532614 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76936f1f-62a7-443c-849c-984b60e36349 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:06.533118 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76936f1f-62a7-443c-849c-984b60e36349 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:06.533545 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76936f1f-62a7-443c-849c-984b60e36349 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:06.544651 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:06.545275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:06.551554 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:06.552121 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:06.552615 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:06.553680 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:06.554220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:06.555015 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:06.738055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-76936f1f-62a7-443c-849c-984b60e36349 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:06.741234 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:06.745896 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-76936f1f-62a7-443c-849c-984b60e36349 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.227336 Aug 10 23:14:06.746772 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 48/97] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:06 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:06.752726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:06.755136 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:06.756755 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-487f5a1a-e1f6-432c-a1a1-fe40245d157d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.216982 Aug 10 23:14:06.757874 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 50/98] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:06 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:07.156017 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-36b540f8-cd24-40c3-bd7a-d1a7b5ebb76c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:07.156755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-36b540f8-cd24-40c3-bd7a-d1a7b5ebb76c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:07.164864 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-36b540f8-cd24-40c3-bd7a-d1a7b5ebb76c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.174712 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-36b540f8-cd24-40c3-bd7a-d1a7b5ebb76c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.175064 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9acc4f1d-185d-4179-8ae4-620689198962 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:07.175518 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-36b540f8-cd24-40c3-bd7a-d1a7b5ebb76c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.175644 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9acc4f1d-185d-4179-8ae4-620689198962 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:07.175729 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-36b540f8-cd24-40c3-bd7a-d1a7b5ebb76c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.175729 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-36b540f8-cd24-40c3-bd7a-d1a7b5ebb76c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.175729 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-36b540f8-cd24-40c3-bd7a-d1a7b5ebb76c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.176498 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9acc4f1d-185d-4179-8ae4-620689198962 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.177003 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9acc4f1d-185d-4179-8ae4-620689198962 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.177440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9acc4f1d-185d-4179-8ae4-620689198962 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.178155 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9acc4f1d-185d-4179-8ae4-620689198962 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.178606 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9acc4f1d-185d-4179-8ae4-620689198962 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.184619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9acc4f1d-185d-4179-8ae4-620689198962 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.379913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-36b540f8-cd24-40c3-bd7a-d1a7b5ebb76c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:07.388075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-36b540f8-cd24-40c3-bd7a-d1a7b5ebb76c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.237281 Aug 10 23:14:07.398689 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 49/99] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:07 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:07.399149 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9acc4f1d-185d-4179-8ae4-620689198962 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:07.399800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9acc4f1d-185d-4179-8ae4-620689198962 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.238038 Aug 10 23:14:07.400899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 51/100] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:07 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:07.767016 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2eefa8c8-fde2-4e5d-af2a-6fdeaec2f7a0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:07.767635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2eefa8c8-fde2-4e5d-af2a-6fdeaec2f7a0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:07.773596 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2eefa8c8-fde2-4e5d-af2a-6fdeaec2f7a0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.774161 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2eefa8c8-fde2-4e5d-af2a-6fdeaec2f7a0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.774604 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2eefa8c8-fde2-4e5d-af2a-6fdeaec2f7a0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.775542 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2eefa8c8-fde2-4e5d-af2a-6fdeaec2f7a0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.775793 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2eefa8c8-fde2-4e5d-af2a-6fdeaec2f7a0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.776219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2eefa8c8-fde2-4e5d-af2a-6fdeaec2f7a0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.779226 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:07.779796 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:07.787353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.787999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.788354 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.789049 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.789494 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.789916 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.980977 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2eefa8c8-fde2-4e5d-af2a-6fdeaec2f7a0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:07.987075 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:07.988740 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2eefa8c8-fde2-4e5d-af2a-6fdeaec2f7a0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.225632 Aug 10 23:14:07.989832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 50/101] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:07 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:07.996445 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:08.007080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:08.007080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0ebcebf7-a332-4709-ac06-45c8a28b0205 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.224000 Aug 10 23:14:08.007080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 52/102] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:07 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:08.410573 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4e440317-5a17-46b5-8743-3624af528ca6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:08.411207 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4e440317-5a17-46b5-8743-3624af528ca6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:08.417773 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e440317-5a17-46b5-8743-3624af528ca6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:08.418290 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e440317-5a17-46b5-8743-3624af528ca6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:08.418754 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e440317-5a17-46b5-8743-3624af528ca6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:08.419479 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e440317-5a17-46b5-8743-3624af528ca6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:08.419912 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e440317-5a17-46b5-8743-3624af528ca6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:08.420340 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e440317-5a17-46b5-8743-3624af528ca6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:08.429715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a42cd715-1fc6-41a0-8a44-b9cb28edc47b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:08.430568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a42cd715-1fc6-41a0-8a44-b9cb28edc47b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:08.436748 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42cd715-1fc6-41a0-8a44-b9cb28edc47b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:08.437356 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42cd715-1fc6-41a0-8a44-b9cb28edc47b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:08.437789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42cd715-1fc6-41a0-8a44-b9cb28edc47b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:08.438509 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42cd715-1fc6-41a0-8a44-b9cb28edc47b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:08.439046 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42cd715-1fc6-41a0-8a44-b9cb28edc47b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:08.439468 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42cd715-1fc6-41a0-8a44-b9cb28edc47b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:08.619566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4e440317-5a17-46b5-8743-3624af528ca6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:08.626597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a42cd715-1fc6-41a0-8a44-b9cb28edc47b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:08.627281 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4e440317-5a17-46b5-8743-3624af528ca6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.220534 Aug 10 23:14:08.628107 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 51/103] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:08 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:08.636646 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a42cd715-1fc6-41a0-8a44-b9cb28edc47b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.215491 Aug 10 23:14:08.646372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 53/104] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:08 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:09.016113 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f3ca7571-e82b-4e40-b9d6-bd01cdb3985b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:09.016680 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f3ca7571-e82b-4e40-b9d6-bd01cdb3985b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:09.021701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:09.022316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:09.023184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3ca7571-e82b-4e40-b9d6-bd01cdb3985b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:09.023684 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3ca7571-e82b-4e40-b9d6-bd01cdb3985b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:09.024176 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3ca7571-e82b-4e40-b9d6-bd01cdb3985b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:09.024887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3ca7571-e82b-4e40-b9d6-bd01cdb3985b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:09.025357 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3ca7571-e82b-4e40-b9d6-bd01cdb3985b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:09.025780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3ca7571-e82b-4e40-b9d6-bd01cdb3985b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:09.030285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:09.030285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:09.030852 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:09.032000 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:09.032579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:09.033095 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:09.240034 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f3ca7571-e82b-4e40-b9d6-bd01cdb3985b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:09.243501 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:09.243789 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f3ca7571-e82b-4e40-b9d6-bd01cdb3985b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.231589 Aug 10 23:14:09.244961 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 52/105] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:09 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:09.253381 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:09.254924 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:09.256230 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9cf547b4-6ff1-4c65-9f7d-27a95d238d94 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.238507 Aug 10 23:14:09.256784 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 54/106] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:09 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:09.648122 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-23c3c028-b861-419e-98df-c998c8f79eaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:09.648744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-23c3c028-b861-419e-98df-c998c8f79eaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:09.655188 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23c3c028-b861-419e-98df-c998c8f79eaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:09.655669 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23c3c028-b861-419e-98df-c998c8f79eaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:09.656105 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23c3c028-b861-419e-98df-c998c8f79eaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:09.656798 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23c3c028-b861-419e-98df-c998c8f79eaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:09.657249 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23c3c028-b861-419e-98df-c998c8f79eaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:09.657671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23c3c028-b861-419e-98df-c998c8f79eaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:09.665178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-73429632-aaa7-434a-aa31-6c5d2f904e20 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:09.667491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-73429632-aaa7-434a-aa31-6c5d2f904e20 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:09.673020 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-73429632-aaa7-434a-aa31-6c5d2f904e20 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:09.673448 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-73429632-aaa7-434a-aa31-6c5d2f904e20 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:09.673941 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-73429632-aaa7-434a-aa31-6c5d2f904e20 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:09.674646 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-73429632-aaa7-434a-aa31-6c5d2f904e20 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:09.675122 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-73429632-aaa7-434a-aa31-6c5d2f904e20 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:09.675549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-73429632-aaa7-434a-aa31-6c5d2f904e20 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:09.858260 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-23c3c028-b861-419e-98df-c998c8f79eaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:09.866498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-23c3c028-b861-419e-98df-c998c8f79eaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.222114 Aug 10 23:14:09.867360 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 53/107] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:09 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:09.871742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-73429632-aaa7-434a-aa31-6c5d2f904e20 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:09.879779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-73429632-aaa7-434a-aa31-6c5d2f904e20 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.218407 Aug 10 23:14:09.880330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 55/108] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:09 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:10.265842 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-dda4b40d-5207-4240-bb4b-e7e042a7a65b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:10.266461 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-dda4b40d-5207-4240-bb4b-e7e042a7a65b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:10.273848 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda4b40d-5207-4240-bb4b-e7e042a7a65b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.274402 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda4b40d-5207-4240-bb4b-e7e042a7a65b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.281314 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda4b40d-5207-4240-bb4b-e7e042a7a65b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.288196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda4b40d-5207-4240-bb4b-e7e042a7a65b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.288196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda4b40d-5207-4240-bb4b-e7e042a7a65b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.288196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda4b40d-5207-4240-bb4b-e7e042a7a65b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.288490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:10.288490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:10.296581 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.297163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.297710 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.303690 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.304834 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.305490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.620762 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-dda4b40d-5207-4240-bb4b-e7e042a7a65b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:10.628873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-dda4b40d-5207-4240-bb4b-e7e042a7a65b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.366830 Aug 10 23:14:10.629475 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 54/109] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:10 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:10.646856 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:10.656980 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:10.658536 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:10.659733 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0daaaa08-7501-4673-aca6-ba260923fbeb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.384052 Aug 10 23:14:10.660458 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 56/110] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:10 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:10.890956 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ee85c66a-fc7f-4cf7-8440-dd6a5b54d6dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:10.891574 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ee85c66a-fc7f-4cf7-8440-dd6a5b54d6dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:10.898422 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ee85c66a-fc7f-4cf7-8440-dd6a5b54d6dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.899141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ee85c66a-fc7f-4cf7-8440-dd6a5b54d6dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.899587 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ee85c66a-fc7f-4cf7-8440-dd6a5b54d6dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.900914 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ee85c66a-fc7f-4cf7-8440-dd6a5b54d6dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.901237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2cd316bd-17bf-45bd-89fc-f5c25b76f36d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:10.901675 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ee85c66a-fc7f-4cf7-8440-dd6a5b54d6dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.901854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2cd316bd-17bf-45bd-89fc-f5c25b76f36d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:10.901984 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ee85c66a-fc7f-4cf7-8440-dd6a5b54d6dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.910050 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cd316bd-17bf-45bd-89fc-f5c25b76f36d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.910548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cd316bd-17bf-45bd-89fc-f5c25b76f36d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.911012 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cd316bd-17bf-45bd-89fc-f5c25b76f36d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.911785 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cd316bd-17bf-45bd-89fc-f5c25b76f36d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.912239 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cd316bd-17bf-45bd-89fc-f5c25b76f36d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.912659 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cd316bd-17bf-45bd-89fc-f5c25b76f36d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.612397 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2cd316bd-17bf-45bd-89fc-f5c25b76f36d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:11.620598 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2cd316bd-17bf-45bd-89fc-f5c25b76f36d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.723730 Aug 10 23:14:11.621261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ee85c66a-fc7f-4cf7-8440-dd6a5b54d6dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:11.634844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 57/111] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:10 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:11.642123 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ee85c66a-fc7f-4cf7-8440-dd6a5b54d6dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.755190 Aug 10 23:14:11.643150 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 55/112] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:10 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:11.657087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-23d33e89-2e38-4314-8458-050af069d1d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:11.657087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-23d33e89-2e38-4314-8458-050af069d1d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:11.663008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d33e89-2e38-4314-8458-050af069d1d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.663718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d33e89-2e38-4314-8458-050af069d1d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.664228 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d33e89-2e38-4314-8458-050af069d1d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.665125 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d33e89-2e38-4314-8458-050af069d1d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.665653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d33e89-2e38-4314-8458-050af069d1d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.666847 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d33e89-2e38-4314-8458-050af069d1d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.687490 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:11.688338 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:11.702160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.702673 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.703229 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.704009 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.712559 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.713072 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:12.201367 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-23d33e89-2e38-4314-8458-050af069d1d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:12.209156 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-23d33e89-2e38-4314-8458-050af069d1d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.563511 Aug 10 23:14:12.209739 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 58/113] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:11 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:12.224393 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:12.233659 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:12.235278 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:12.236631 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b32df5d0-d991-4a11-9ca9-44a3b270110a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.557333 Aug 10 23:14:12.237415 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 56/114] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:11 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:12.641820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d7de353b-6214-4f33-aea2-557ad803df71 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:12.642438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d7de353b-6214-4f33-aea2-557ad803df71 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:12.648520 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7de353b-6214-4f33-aea2-557ad803df71 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:12.649068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7de353b-6214-4f33-aea2-557ad803df71 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:12.649507 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7de353b-6214-4f33-aea2-557ad803df71 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:12.650258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7de353b-6214-4f33-aea2-557ad803df71 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:12.650744 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7de353b-6214-4f33-aea2-557ad803df71 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:12.651175 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7de353b-6214-4f33-aea2-557ad803df71 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:12.673271 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c3590fa8-98b2-4509-a55c-5ee52bdb35d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:12.674360 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c3590fa8-98b2-4509-a55c-5ee52bdb35d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:12.685530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3590fa8-98b2-4509-a55c-5ee52bdb35d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:12.686371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3590fa8-98b2-4509-a55c-5ee52bdb35d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:12.687192 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3590fa8-98b2-4509-a55c-5ee52bdb35d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:12.688386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3590fa8-98b2-4509-a55c-5ee52bdb35d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:12.689224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3590fa8-98b2-4509-a55c-5ee52bdb35d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:12.689972 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3590fa8-98b2-4509-a55c-5ee52bdb35d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:12.983982 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d7de353b-6214-4f33-aea2-557ad803df71 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:12.991480 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c3590fa8-98b2-4509-a55c-5ee52bdb35d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:12.992563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d7de353b-6214-4f33-aea2-557ad803df71 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.354561 Aug 10 23:14:12.993139 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 59/115] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:12 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:13.001137 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c3590fa8-98b2-4509-a55c-5ee52bdb35d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.334027 Aug 10 23:14:13.001137 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 57/116] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:12 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:13.006091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-259e546e-f2d3-4428-9a28-ecabd3006624 req-d747f95f-34c8-4092-a9bd-62cb925a97a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d062824b-f7a6-4380-a622-5bba74816355", "tag": "6056ee81-d58a-4644-a5ae-8077d23b8e92"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:13.017140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-259e546e-f2d3-4428-9a28-ecabd3006624 req-d747f95f-34c8-4092-a9bd-62cb925a97a5 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:13.017612 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-259e546e-f2d3-4428-9a28-ecabd3006624 req-d747f95f-34c8-4092-a9bd-62cb925a97a5 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:13.018036 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-259e546e-f2d3-4428-9a28-ecabd3006624 req-d747f95f-34c8-4092-a9bd-62cb925a97a5 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:13.030451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-259e546e-f2d3-4428-9a28-ecabd3006624 req-d747f95f-34c8-4092-a9bd-62cb925a97a5 service nova] Creating event network-changed:6056ee81-d58a-4644-a5ae-8077d23b8e92 for instance d062824b-f7a6-4380-a622-5bba74816355 on hv-cinder-85144 Aug 10 23:14:13.035600 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-259e546e-f2d3-4428-9a28-ecabd3006624 req-d747f95f-34c8-4092-a9bd-62cb925a97a5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033133 Aug 10 23:14:13.036321 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 58/117] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:13.231027 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a7cda027-7739-4fd4-aab6-645f2dd80cac tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:13.231699 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a7cda027-7739-4fd4-aab6-645f2dd80cac tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:13.239125 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a7cda027-7739-4fd4-aab6-645f2dd80cac tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:13.239614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a7cda027-7739-4fd4-aab6-645f2dd80cac tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:13.240046 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a7cda027-7739-4fd4-aab6-645f2dd80cac tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:13.240750 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a7cda027-7739-4fd4-aab6-645f2dd80cac tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:13.241199 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a7cda027-7739-4fd4-aab6-645f2dd80cac tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:13.253152 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a7cda027-7739-4fd4-aab6-645f2dd80cac tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:13.261597 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:13.262267 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:13.268469 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:13.269205 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:13.269636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:13.270330 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:13.270979 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:13.271401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:13.640232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a7cda027-7739-4fd4-aab6-645f2dd80cac tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:13.644870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:13.648387 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=100 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:13.651402 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a7cda027-7739-4fd4-aab6-645f2dd80cac tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.424159 Aug 10 23:14:13.657169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:13.659264 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:13.660381 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c9be4ce9-812b-4b04-9d60-e9321b1bb2ed tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.404009 Aug 10 23:14:13.660935 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 59/118] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:13 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:13.667473 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 60/119] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:13 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:14.012842 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6b6daa50-50e9-4a34-8def-56e8c8fb55f9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:14.013446 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6b6daa50-50e9-4a34-8def-56e8c8fb55f9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:14.019578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b6daa50-50e9-4a34-8def-56e8c8fb55f9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:14.020082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b6daa50-50e9-4a34-8def-56e8c8fb55f9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:14.020513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b6daa50-50e9-4a34-8def-56e8c8fb55f9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:14.021411 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b6daa50-50e9-4a34-8def-56e8c8fb55f9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:14.021760 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b6daa50-50e9-4a34-8def-56e8c8fb55f9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:14.022079 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b6daa50-50e9-4a34-8def-56e8c8fb55f9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:14.022412 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6b8c38a6-b347-4c00-8217-8c9829c8478e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:14.023171 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6b8c38a6-b347-4c00-8217-8c9829c8478e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:14.029790 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b8c38a6-b347-4c00-8217-8c9829c8478e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:14.030351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b8c38a6-b347-4c00-8217-8c9829c8478e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:14.031911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b8c38a6-b347-4c00-8217-8c9829c8478e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:14.031911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b8c38a6-b347-4c00-8217-8c9829c8478e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:14.032103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b8c38a6-b347-4c00-8217-8c9829c8478e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:14.032464 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b8c38a6-b347-4c00-8217-8c9829c8478e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:14.271944 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6b6daa50-50e9-4a34-8def-56e8c8fb55f9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:14.280063 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6b8c38a6-b347-4c00-8217-8c9829c8478e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:14.281964 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6b6daa50-50e9-4a34-8def-56e8c8fb55f9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.272628 Aug 10 23:14:14.282747 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 60/120] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:14 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:14.293480 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6b8c38a6-b347-4c00-8217-8c9829c8478e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.275226 Aug 10 23:14:14.294144 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 61/121] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:14 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:14.673562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-209e0524-63ba-4d54-85bb-6f1e67b76111 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:14.674191 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-209e0524-63ba-4d54-85bb-6f1e67b76111 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:14.686206 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:14.687229 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:14.718426 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-209e0524-63ba-4d54-85bb-6f1e67b76111 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:14.721836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-209e0524-63ba-4d54-85bb-6f1e67b76111 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:14.724439 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-209e0524-63ba-4d54-85bb-6f1e67b76111 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:14.725962 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-209e0524-63ba-4d54-85bb-6f1e67b76111 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:14.726684 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-209e0524-63ba-4d54-85bb-6f1e67b76111 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:14.731156 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-209e0524-63ba-4d54-85bb-6f1e67b76111 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:14.743471 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:14.745911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:14.747102 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:14.749081 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:14.751636 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:14.753035 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:15.332426 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-209e0524-63ba-4d54-85bb-6f1e67b76111 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:15.348715 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-209e0524-63ba-4d54-85bb-6f1e67b76111 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.678996 Aug 10 23:14:15.364610 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 61/122] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:14 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:15.364610 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-475043f0-54c7-4870-8e90-839aa8243464 req-ed159b2e-9007-455d-a611-87adf8d2a89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d", "tag": "c83fa2ce-f061-4547-9cb4-a740a906feac"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:15.367975 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-475043f0-54c7-4870-8e90-839aa8243464 req-ed159b2e-9007-455d-a611-87adf8d2a89d service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:15.368462 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-475043f0-54c7-4870-8e90-839aa8243464 req-ed159b2e-9007-455d-a611-87adf8d2a89d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:15.369133 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-475043f0-54c7-4870-8e90-839aa8243464 req-ed159b2e-9007-455d-a611-87adf8d2a89d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:15.381994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:15.383570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-475043f0-54c7-4870-8e90-839aa8243464 req-ed159b2e-9007-455d-a611-87adf8d2a89d service nova] Creating event network-changed:c83fa2ce-f061-4547-9cb4-a740a906feac for instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d on hv-cinder-85144 Aug 10 23:14:15.389235 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-475043f0-54c7-4870-8e90-839aa8243464 req-ed159b2e-9007-455d-a611-87adf8d2a89d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035057 Aug 10 23:14:15.389836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 62/123] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:15.395247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:15.396032 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3b470349-b7f2-4c9e-bf99-c31f2f2c3c7f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:15.396732 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3b470349-b7f2-4c9e-bf99-c31f2f2c3c7f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:15.399136 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:15.400936 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-80035d14-ffca-449b-8a29-3c1ef3d600f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.721503 Aug 10 23:14:15.404160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 62/124] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:14 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:15.404280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b470349-b7f2-4c9e-bf99-c31f2f2c3c7f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:15.404280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b470349-b7f2-4c9e-bf99-c31f2f2c3c7f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:15.404730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b470349-b7f2-4c9e-bf99-c31f2f2c3c7f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:15.405445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b470349-b7f2-4c9e-bf99-c31f2f2c3c7f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:15.405907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b470349-b7f2-4c9e-bf99-c31f2f2c3c7f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:15.406335 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b470349-b7f2-4c9e-bf99-c31f2f2c3c7f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:15.415597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c4ff8994-b25f-4528-b440-722ec11f6768 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:15.416689 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c4ff8994-b25f-4528-b440-722ec11f6768 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:15.424145 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4ff8994-b25f-4528-b440-722ec11f6768 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:15.425830 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4ff8994-b25f-4528-b440-722ec11f6768 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:15.426544 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4ff8994-b25f-4528-b440-722ec11f6768 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:15.427597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4ff8994-b25f-4528-b440-722ec11f6768 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:15.429018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4ff8994-b25f-4528-b440-722ec11f6768 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:15.429787 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4ff8994-b25f-4528-b440-722ec11f6768 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:15.694695 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c4ff8994-b25f-4528-b440-722ec11f6768 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:15.703751 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c4ff8994-b25f-4528-b440-722ec11f6768 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.297960 Aug 10 23:14:15.718078 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 63/125] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:15 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:15.725720 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3b470349-b7f2-4c9e-bf99-c31f2f2c3c7f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:15.730389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=100 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:15.735437 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3b470349-b7f2-4c9e-bf99-c31f2f2c3c7f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.344188 Aug 10 23:14:15.749059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 63/126] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:15 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:16.372791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-894c1910-9f96-4f6d-89a1-b0c9c8b3a4f8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:16.373432 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-894c1910-9f96-4f6d-89a1-b0c9c8b3a4f8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:16.379449 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-894c1910-9f96-4f6d-89a1-b0c9c8b3a4f8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:16.379935 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-894c1910-9f96-4f6d-89a1-b0c9c8b3a4f8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:16.380369 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-894c1910-9f96-4f6d-89a1-b0c9c8b3a4f8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:16.381067 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-894c1910-9f96-4f6d-89a1-b0c9c8b3a4f8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:16.381518 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-894c1910-9f96-4f6d-89a1-b0c9c8b3a4f8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:16.381939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-894c1910-9f96-4f6d-89a1-b0c9c8b3a4f8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:16.434172 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:16.435511 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:16.443395 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:16.444089 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:16.445077 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:16.446006 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:16.447698 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:16.448369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:16.669552 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-894c1910-9f96-4f6d-89a1-b0c9c8b3a4f8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:16.679305 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-894c1910-9f96-4f6d-89a1-b0c9c8b3a4f8 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.310572 Aug 10 23:14:16.693919 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 64/127] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:16 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:16.713094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:16.728485 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-02f77d52-bab9-4374-aa96-4ac25017eaa8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:16.731438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-02f77d52-bab9-4374-aa96-4ac25017eaa8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:16.732020 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:16.733626 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:16.734969 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-043fe033-b042-4f6e-9f66-b250f6d0edad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.311508 Aug 10 23:14:16.735392 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02f77d52-bab9-4374-aa96-4ac25017eaa8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:16.736184 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02f77d52-bab9-4374-aa96-4ac25017eaa8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:16.736797 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02f77d52-bab9-4374-aa96-4ac25017eaa8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:16.737662 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02f77d52-bab9-4374-aa96-4ac25017eaa8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:16.738189 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02f77d52-bab9-4374-aa96-4ac25017eaa8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:16.738820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02f77d52-bab9-4374-aa96-4ac25017eaa8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:16.751037 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 64/128] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:16 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:16.762249 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-47d96681-1e5e-4446-bee3-8fc021912117 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:16.762995 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-47d96681-1e5e-4446-bee3-8fc021912117 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:16.769836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-47d96681-1e5e-4446-bee3-8fc021912117 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:16.770564 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-47d96681-1e5e-4446-bee3-8fc021912117 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:16.771126 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-47d96681-1e5e-4446-bee3-8fc021912117 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:16.772198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-47d96681-1e5e-4446-bee3-8fc021912117 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:16.772724 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-47d96681-1e5e-4446-bee3-8fc021912117 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:16.773199 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-47d96681-1e5e-4446-bee3-8fc021912117 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:16.984065 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-02f77d52-bab9-4374-aa96-4ac25017eaa8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:16.992320 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-02f77d52-bab9-4374-aa96-4ac25017eaa8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.268571 Aug 10 23:14:16.993693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 65/129] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:16 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:16.998058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-47d96681-1e5e-4446-bee3-8fc021912117 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:17.006442 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-47d96681-1e5e-4446-bee3-8fc021912117 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.249342 Aug 10 23:14:17.007256 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 65/130] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:16 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:17.717771 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4dde343d-f575-4331-b7e9-e8380af1ab0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:17.720172 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4dde343d-f575-4331-b7e9-e8380af1ab0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:17.735798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dde343d-f575-4331-b7e9-e8380af1ab0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.737060 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dde343d-f575-4331-b7e9-e8380af1ab0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.737914 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dde343d-f575-4331-b7e9-e8380af1ab0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:17.740998 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dde343d-f575-4331-b7e9-e8380af1ab0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.742158 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dde343d-f575-4331-b7e9-e8380af1ab0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.743652 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dde343d-f575-4331-b7e9-e8380af1ab0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:17.758137 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:17.759921 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:17.768308 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.775983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.776624 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:17.777614 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.778218 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.778832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.467334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4dde343d-f575-4331-b7e9-e8380af1ab0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:18.481649 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:18.486081 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4dde343d-f575-4331-b7e9-e8380af1ab0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.788567 Aug 10 23:14:18.486266 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 66/131] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:17 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:18.507935 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4d923c59-95ca-49e4-93d1-4382233e1015 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:18.508268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4d923c59-95ca-49e4-93d1-4382233e1015 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:18.517176 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d923c59-95ca-49e4-93d1-4382233e1015 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:18.517674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d923c59-95ca-49e4-93d1-4382233e1015 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:18.518175 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d923c59-95ca-49e4-93d1-4382233e1015 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.518993 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d923c59-95ca-49e4-93d1-4382233e1015 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:18.520009 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d923c59-95ca-49e4-93d1-4382233e1015 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:18.520725 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d923c59-95ca-49e4-93d1-4382233e1015 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.526319 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:18.539735 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:18.541266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-df088669-ec9e-4a96-b33b-18b1b7241208 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.787179 Aug 10 23:14:18.542336 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 66/132] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:17 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:18.557602 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ae43cf6a-9e21-4d04-955d-6c1b34bc6bf9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:18.558484 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ae43cf6a-9e21-4d04-955d-6c1b34bc6bf9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:18.565222 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae43cf6a-9e21-4d04-955d-6c1b34bc6bf9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:18.565977 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae43cf6a-9e21-4d04-955d-6c1b34bc6bf9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:18.566532 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae43cf6a-9e21-4d04-955d-6c1b34bc6bf9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.567306 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae43cf6a-9e21-4d04-955d-6c1b34bc6bf9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:18.568907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae43cf6a-9e21-4d04-955d-6c1b34bc6bf9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:18.569520 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae43cf6a-9e21-4d04-955d-6c1b34bc6bf9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.864389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4d923c59-95ca-49e4-93d1-4382233e1015 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:18.866159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ae43cf6a-9e21-4d04-955d-6c1b34bc6bf9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:18.874805 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4d923c59-95ca-49e4-93d1-4382233e1015 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.387445 Aug 10 23:14:18.875397 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 67/133] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:18 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:18.875655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ae43cf6a-9e21-4d04-955d-6c1b34bc6bf9 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.332084 Aug 10 23:14:18.876363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 67/134] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:18 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:19.338693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-fdf6b02b-2fe1-45dd-be69-7b74e588db8c req-74a9f85e-9f3e-4495-88bb-e0066bcb95b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a85987-a755-456a-9d00-0992cbe4368a", "name": "network-vif-plugged", "status": "completed", "tag": "f1b4d3c9-dbce-4d0a-a2e7-1dfdd40931a0"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:19.349032 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-fdf6b02b-2fe1-45dd-be69-7b74e588db8c req-74a9f85e-9f3e-4495-88bb-e0066bcb95b3 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.349576 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-fdf6b02b-2fe1-45dd-be69-7b74e588db8c req-74a9f85e-9f3e-4495-88bb-e0066bcb95b3 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.350096 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-fdf6b02b-2fe1-45dd-be69-7b74e588db8c req-74a9f85e-9f3e-4495-88bb-e0066bcb95b3 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.364645 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-fdf6b02b-2fe1-45dd-be69-7b74e588db8c req-74a9f85e-9f3e-4495-88bb-e0066bcb95b3 service nova] Creating event network-vif-plugged:f1b4d3c9-dbce-4d0a-a2e7-1dfdd40931a0 for instance e3a85987-a755-456a-9d00-0992cbe4368a on hv-cinder-85144 Aug 10 23:14:19.370575 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-fdf6b02b-2fe1-45dd-be69-7b74e588db8c req-74a9f85e-9f3e-4495-88bb-e0066bcb95b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.494056 Aug 10 23:14:19.371207 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 68/135] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:19.510180 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ca297a66-e1e6-428d-aa7a-1736d6c5db22 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:19.511043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ca297a66-e1e6-428d-aa7a-1736d6c5db22 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:19.517146 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ca297a66-e1e6-428d-aa7a-1736d6c5db22 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.517617 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ca297a66-e1e6-428d-aa7a-1736d6c5db22 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.518044 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ca297a66-e1e6-428d-aa7a-1736d6c5db22 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.518755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ca297a66-e1e6-428d-aa7a-1736d6c5db22 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.519202 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ca297a66-e1e6-428d-aa7a-1736d6c5db22 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.519620 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ca297a66-e1e6-428d-aa7a-1736d6c5db22 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.566549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:19.567715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:19.576072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.576814 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.577321 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.582948 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.582948 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.582948 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.727094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ca297a66-e1e6-428d-aa7a-1736d6c5db22 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:19.734937 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ca297a66-e1e6-428d-aa7a-1736d6c5db22 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.228533 Aug 10 23:14:19.735823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 68/136] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:19 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:19.762398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:19.770865 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:19.772368 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:19.773468 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-19099e5e-3336-448d-8c96-83224266c283 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.211740 Aug 10 23:14:19.778000 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 69/137] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:19 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:19.897060 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-24af9ba6-a928-4ab8-bf01-43ea6aae2995 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:19.897616 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-251297b3-75c8-47d4-9c63-f7de9bf9069d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:19.898005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-24af9ba6-a928-4ab8-bf01-43ea6aae2995 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:19.898540 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-251297b3-75c8-47d4-9c63-f7de9bf9069d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:19.904833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-24af9ba6-a928-4ab8-bf01-43ea6aae2995 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.905384 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-24af9ba6-a928-4ab8-bf01-43ea6aae2995 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.905910 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-24af9ba6-a928-4ab8-bf01-43ea6aae2995 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.906978 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-24af9ba6-a928-4ab8-bf01-43ea6aae2995 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.907213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-24af9ba6-a928-4ab8-bf01-43ea6aae2995 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.907701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-24af9ba6-a928-4ab8-bf01-43ea6aae2995 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.909548 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-251297b3-75c8-47d4-9c63-f7de9bf9069d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.910968 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-251297b3-75c8-47d4-9c63-f7de9bf9069d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.912223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-251297b3-75c8-47d4-9c63-f7de9bf9069d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.914857 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-251297b3-75c8-47d4-9c63-f7de9bf9069d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.920212 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-251297b3-75c8-47d4-9c63-f7de9bf9069d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.920745 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-251297b3-75c8-47d4-9c63-f7de9bf9069d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:20.149734 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-24af9ba6-a928-4ab8-bf01-43ea6aae2995 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:20.151512 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-251297b3-75c8-47d4-9c63-f7de9bf9069d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:20.160005 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-251297b3-75c8-47d4-9c63-f7de9bf9069d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.266658 Aug 10 23:14:20.160792 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 69/138] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:19 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:20.163596 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-24af9ba6-a928-4ab8-bf01-43ea6aae2995 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.270667 Aug 10 23:14:20.164410 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 70/139] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:19 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:20.756865 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-096f7c1a-5963-4816-b9ac-31e828ba63d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:20.757956 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-096f7c1a-5963-4816-b9ac-31e828ba63d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:20.765170 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-096f7c1a-5963-4816-b9ac-31e828ba63d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:20.765911 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-096f7c1a-5963-4816-b9ac-31e828ba63d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:20.766707 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-096f7c1a-5963-4816-b9ac-31e828ba63d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:20.767650 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-096f7c1a-5963-4816-b9ac-31e828ba63d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:20.769149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-096f7c1a-5963-4816-b9ac-31e828ba63d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:20.769149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-096f7c1a-5963-4816-b9ac-31e828ba63d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:20.796664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:20.797285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:20.805662 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:20.806155 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:20.807299 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:20.808051 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:20.808544 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:20.819285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:20.984891 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-096f7c1a-5963-4816-b9ac-31e828ba63d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:20.992627 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-096f7c1a-5963-4816-b9ac-31e828ba63d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.239482 Aug 10 23:14:20.993202 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 70/140] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:20 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:21.029967 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:21.037883 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:21.039396 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:21.040516 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4a189a9c-bc19-4c6b-840c-136cf3910144 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.247763 Aug 10 23:14:21.042167 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 71/141] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:20 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:21.184904 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6cc94d39-0bb8-434e-8b26-6d4803db460c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:21.185587 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6cc94d39-0bb8-434e-8b26-6d4803db460c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:21.187333 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-50e2e0d9-1be6-40ec-97b4-6db8d25d51bb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:21.188048 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-50e2e0d9-1be6-40ec-97b4-6db8d25d51bb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:21.191821 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc94d39-0bb8-434e-8b26-6d4803db460c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:21.192561 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc94d39-0bb8-434e-8b26-6d4803db460c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:21.193060 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc94d39-0bb8-434e-8b26-6d4803db460c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:21.193855 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc94d39-0bb8-434e-8b26-6d4803db460c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:21.194415 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc94d39-0bb8-434e-8b26-6d4803db460c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:21.194934 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc94d39-0bb8-434e-8b26-6d4803db460c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:21.196738 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50e2e0d9-1be6-40ec-97b4-6db8d25d51bb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:21.197520 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50e2e0d9-1be6-40ec-97b4-6db8d25d51bb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:21.198288 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50e2e0d9-1be6-40ec-97b4-6db8d25d51bb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:21.200259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50e2e0d9-1be6-40ec-97b4-6db8d25d51bb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:21.200718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50e2e0d9-1be6-40ec-97b4-6db8d25d51bb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:21.205426 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50e2e0d9-1be6-40ec-97b4-6db8d25d51bb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:21.453918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-50e2e0d9-1be6-40ec-97b4-6db8d25d51bb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:21.457223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6cc94d39-0bb8-434e-8b26-6d4803db460c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:21.463975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-50e2e0d9-1be6-40ec-97b4-6db8d25d51bb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.281936 Aug 10 23:14:21.465127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 72/142] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:21 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:21.475077 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6cc94d39-0bb8-434e-8b26-6d4803db460c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.294025 Aug 10 23:14:21.475935 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 71/143] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:21 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:21.892310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-ea395339-71f5-4573-a352-35746c06fe29 req-c62058c5-bc45-4b5f-a67b-18638a84314d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae8526a-d85b-4176-a4b8-938d4617b7a3", "name": "network-vif-plugged", "status": "completed", "tag": "e427d004-9e4c-4ac6-a10d-f49430b10c39"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:21.904069 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-ea395339-71f5-4573-a352-35746c06fe29 req-c62058c5-bc45-4b5f-a67b-18638a84314d service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:21.904815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-ea395339-71f5-4573-a352-35746c06fe29 req-c62058c5-bc45-4b5f-a67b-18638a84314d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:21.905695 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-ea395339-71f5-4573-a352-35746c06fe29 req-c62058c5-bc45-4b5f-a67b-18638a84314d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:21.927108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-ea395339-71f5-4573-a352-35746c06fe29 req-c62058c5-bc45-4b5f-a67b-18638a84314d service nova] Creating event network-vif-plugged:e427d004-9e4c-4ac6-a10d-f49430b10c39 for instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 on hv-cinder-85144 Aug 10 23:14:21.933143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-ea395339-71f5-4573-a352-35746c06fe29 req-c62058c5-bc45-4b5f-a67b-18638a84314d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044923 Aug 10 23:14:21.934072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 73/144] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:22.017289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5c221db1-8244-4955-8e2c-811199115221 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:22.021407 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5c221db1-8244-4955-8e2c-811199115221 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:22.030136 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c221db1-8244-4955-8e2c-811199115221 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.031057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c221db1-8244-4955-8e2c-811199115221 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.031863 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c221db1-8244-4955-8e2c-811199115221 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:22.033799 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c221db1-8244-4955-8e2c-811199115221 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.034463 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c221db1-8244-4955-8e2c-811199115221 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.035523 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c221db1-8244-4955-8e2c-811199115221 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:22.069223 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:22.070926 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:22.078465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.079449 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.080431 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:22.081485 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.082092 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.082890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:22.226227 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5c221db1-8244-4955-8e2c-811199115221 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:22.236146 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5c221db1-8244-4955-8e2c-811199115221 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.225600 Aug 10 23:14:22.237066 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 72/145] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:22 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:22.314398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:22.325692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:22.327635 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:22.328769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b0346780-2d40-4e8e-8198-c41dc7bfe0e6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.268006 Aug 10 23:14:22.329331 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 74/146] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:22 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:22.485216 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a8b48ec5-6baf-4aa2-afb0-e146e7571769 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:22.486750 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a8b48ec5-6baf-4aa2-afb0-e146e7571769 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:22.493567 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8b48ec5-6baf-4aa2-afb0-e146e7571769 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.494586 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8b48ec5-6baf-4aa2-afb0-e146e7571769 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.495046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8b48ec5-6baf-4aa2-afb0-e146e7571769 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:22.495953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8b48ec5-6baf-4aa2-afb0-e146e7571769 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.496406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8b48ec5-6baf-4aa2-afb0-e146e7571769 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.496832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8b48ec5-6baf-4aa2-afb0-e146e7571769 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:22.497452 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-53ba410b-daf1-44b5-99ea-e74ea7a70419 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:22.498085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-53ba410b-daf1-44b5-99ea-e74ea7a70419 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:22.507438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53ba410b-daf1-44b5-99ea-e74ea7a70419 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.508264 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53ba410b-daf1-44b5-99ea-e74ea7a70419 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.508942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53ba410b-daf1-44b5-99ea-e74ea7a70419 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:22.510687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53ba410b-daf1-44b5-99ea-e74ea7a70419 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.511379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53ba410b-daf1-44b5-99ea-e74ea7a70419 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.512033 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53ba410b-daf1-44b5-99ea-e74ea7a70419 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:22.767084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-53ba410b-daf1-44b5-99ea-e74ea7a70419 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:22.779287 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-53ba410b-daf1-44b5-99ea-e74ea7a70419 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.286461 Aug 10 23:14:22.780802 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 75/147] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:22 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:22.796360 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a8b48ec5-6baf-4aa2-afb0-e146e7571769 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:22.803837 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a8b48ec5-6baf-4aa2-afb0-e146e7571769 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.322356 Aug 10 23:14:22.804411 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 73/148] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:22 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:23.258139 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0660b09f-dd1c-43a2-bc02-e2064a73fc73 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:23.259317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0660b09f-dd1c-43a2-bc02-e2064a73fc73 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:23.276037 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0660b09f-dd1c-43a2-bc02-e2064a73fc73 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.276533 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0660b09f-dd1c-43a2-bc02-e2064a73fc73 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.283353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0660b09f-dd1c-43a2-bc02-e2064a73fc73 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.285679 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0660b09f-dd1c-43a2-bc02-e2064a73fc73 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.286174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0660b09f-dd1c-43a2-bc02-e2064a73fc73 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.286623 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0660b09f-dd1c-43a2-bc02-e2064a73fc73 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.352539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:23.354648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:23.362035 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=97 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:23.363762 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.370422 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.372092 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.373310 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.373924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.374565 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.716445 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0660b09f-dd1c-43a2-bc02-e2064a73fc73 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:23.735094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0660b09f-dd1c-43a2-bc02-e2064a73fc73 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.471902 Aug 10 23:14:23.735768 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 76/149] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:23 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:23.793779 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:23.800196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-43a43962-4ca1-4423-b6de-3e79807756a7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:23.800507 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-43a43962-4ca1-4423-b6de-3e79807756a7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:23.810646 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=99 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:23.814331 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43a43962-4ca1-4423-b6de-3e79807756a7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.814331 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43a43962-4ca1-4423-b6de-3e79807756a7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.814712 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43a43962-4ca1-4423-b6de-3e79807756a7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.815454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43a43962-4ca1-4423-b6de-3e79807756a7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.815924 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43a43962-4ca1-4423-b6de-3e79807756a7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.816360 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43a43962-4ca1-4423-b6de-3e79807756a7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.821659 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:23.827135 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:23.832578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-579fbcfb-8989-4ef0-b120-25b2e31af5af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.484171 Aug 10 23:14:23.846945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 74/150] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:23 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:23.852340 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e58b0706-e674-4e5c-aeda-a409eeac2797 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:23.854238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e58b0706-e674-4e5c-aeda-a409eeac2797 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:23.861268 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e58b0706-e674-4e5c-aeda-a409eeac2797 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.861757 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e58b0706-e674-4e5c-aeda-a409eeac2797 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.862386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e58b0706-e674-4e5c-aeda-a409eeac2797 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.863330 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e58b0706-e674-4e5c-aeda-a409eeac2797 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.864125 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e58b0706-e674-4e5c-aeda-a409eeac2797 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.864699 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e58b0706-e674-4e5c-aeda-a409eeac2797 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.088927 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-43a43962-4ca1-4423-b6de-3e79807756a7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:24.097452 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-43a43962-4ca1-4423-b6de-3e79807756a7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.301285 Aug 10 23:14:24.098240 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 77/151] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:23 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:24.110839 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e58b0706-e674-4e5c-aeda-a409eeac2797 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:24.112032 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e58b0706-e674-4e5c-aeda-a409eeac2797 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.274861 Aug 10 23:14:24.116066 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 75/152] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:23 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:24.125964 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-f0d8fb06-1d18-4b4c-8dc8-02fea255ea43 req-42f3bc21-1ba7-48ea-ac9c-44e50b522faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d", "name": "network-vif-plugged", "status": "completed", "tag": "c83fa2ce-f061-4547-9cb4-a740a906feac"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:24.146939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-f0d8fb06-1d18-4b4c-8dc8-02fea255ea43 req-42f3bc21-1ba7-48ea-ac9c-44e50b522faa service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.148140 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-f0d8fb06-1d18-4b4c-8dc8-02fea255ea43 req-42f3bc21-1ba7-48ea-ac9c-44e50b522faa service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.148922 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-f0d8fb06-1d18-4b4c-8dc8-02fea255ea43 req-42f3bc21-1ba7-48ea-ac9c-44e50b522faa service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.164064 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-f0d8fb06-1d18-4b4c-8dc8-02fea255ea43 req-42f3bc21-1ba7-48ea-ac9c-44e50b522faa service nova] Creating event network-vif-plugged:c83fa2ce-f061-4547-9cb4-a740a906feac for instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d on hv-cinder-85144 Aug 10 23:14:24.171635 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-f0d8fb06-1d18-4b4c-8dc8-02fea255ea43 req-42f3bc21-1ba7-48ea-ac9c-44e50b522faa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056570 Aug 10 23:14:24.172735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 78/153] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:24.757377 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-063542d3-f5de-4e32-b267-5799830fb406 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:24.757994 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-063542d3-f5de-4e32-b267-5799830fb406 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:24.764911 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-063542d3-f5de-4e32-b267-5799830fb406 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.765398 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-063542d3-f5de-4e32-b267-5799830fb406 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.765836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-063542d3-f5de-4e32-b267-5799830fb406 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.766557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-063542d3-f5de-4e32-b267-5799830fb406 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.767044 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-063542d3-f5de-4e32-b267-5799830fb406 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.767466 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-063542d3-f5de-4e32-b267-5799830fb406 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.860042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:24.860747 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:24.867325 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.867812 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.868252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.869451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.869899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.870491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.889488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=100 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:24.896855 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-063542d3-f5de-4e32-b267-5799830fb406 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:24.905341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-063542d3-f5de-4e32-b267-5799830fb406 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.151650 Aug 10 23:14:24.906038 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 76/154] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:24 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:25.010585 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:25.018678 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:25.020200 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:25.021296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7c19c8b1-f522-4257-9586-25763e720cda tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.165914 Aug 10 23:14:25.021857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 79/155] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:24 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:25.123279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-97d20f70-200b-4cd9-8dba-a48af0b24970 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:25.127310 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-97d20f70-200b-4cd9-8dba-a48af0b24970 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:25.129816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97d20f70-200b-4cd9-8dba-a48af0b24970 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:25.130305 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97d20f70-200b-4cd9-8dba-a48af0b24970 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:25.130797 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97d20f70-200b-4cd9-8dba-a48af0b24970 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:25.131494 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97d20f70-200b-4cd9-8dba-a48af0b24970 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:25.131950 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97d20f70-200b-4cd9-8dba-a48af0b24970 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:25.132382 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97d20f70-200b-4cd9-8dba-a48af0b24970 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:25.136042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-85c1d7f5-c160-4bd7-b042-1275838d7d3d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:25.136656 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-85c1d7f5-c160-4bd7-b042-1275838d7d3d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:25.142670 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-85c1d7f5-c160-4bd7-b042-1275838d7d3d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:25.143182 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-85c1d7f5-c160-4bd7-b042-1275838d7d3d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:25.143614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-85c1d7f5-c160-4bd7-b042-1275838d7d3d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:25.144307 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-85c1d7f5-c160-4bd7-b042-1275838d7d3d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:25.144763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-85c1d7f5-c160-4bd7-b042-1275838d7d3d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:25.145189 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-85c1d7f5-c160-4bd7-b042-1275838d7d3d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:25.332060 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-97d20f70-200b-4cd9-8dba-a48af0b24970 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:25.335971 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-85c1d7f5-c160-4bd7-b042-1275838d7d3d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:25.339980 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-97d20f70-200b-4cd9-8dba-a48af0b24970 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.221180 Aug 10 23:14:25.340575 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 77/156] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:25 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:25.343597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-85c1d7f5-c160-4bd7-b042-1275838d7d3d tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.211317 Aug 10 23:14:25.344162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 80/157] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:25 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:25.928465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6aeb0c6d-e530-4c92-a32c-652a4bf90e78 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:25.928465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6aeb0c6d-e530-4c92-a32c-652a4bf90e78 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:25.935272 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6aeb0c6d-e530-4c92-a32c-652a4bf90e78 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:25.935811 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6aeb0c6d-e530-4c92-a32c-652a4bf90e78 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:25.936385 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6aeb0c6d-e530-4c92-a32c-652a4bf90e78 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:25.937084 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6aeb0c6d-e530-4c92-a32c-652a4bf90e78 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:25.937555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6aeb0c6d-e530-4c92-a32c-652a4bf90e78 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:25.937976 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6aeb0c6d-e530-4c92-a32c-652a4bf90e78 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.052401 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:26.053114 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:26.066262 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:26.067004 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:26.067604 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.068517 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:26.069453 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:26.070054 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.165701 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6aeb0c6d-e530-4c92-a32c-652a4bf90e78 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:26.177371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6aeb0c6d-e530-4c92-a32c-652a4bf90e78 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.255822 Aug 10 23:14:26.178294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 78/158] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:25 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:26.237631 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:26.249390 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:26.251903 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:26.253306 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a00c5ccd-1a79-4d8a-aa74-6549672e35ad tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.205149 Aug 10 23:14:26.253905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 81/159] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:26 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:26.361716 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-98d785f5-7ba2-4d07-9729-8bb8d23a5570 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:26.362330 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-98d785f5-7ba2-4d07-9729-8bb8d23a5570 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:26.364066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-764c29bf-cd9e-43cc-9951-2258b0af271f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:26.364922 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-764c29bf-cd9e-43cc-9951-2258b0af271f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:26.369273 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-98d785f5-7ba2-4d07-9729-8bb8d23a5570 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:26.369999 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-98d785f5-7ba2-4d07-9729-8bb8d23a5570 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:26.370430 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-98d785f5-7ba2-4d07-9729-8bb8d23a5570 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.371180 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-98d785f5-7ba2-4d07-9729-8bb8d23a5570 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:26.372297 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-98d785f5-7ba2-4d07-9729-8bb8d23a5570 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:26.372592 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-764c29bf-cd9e-43cc-9951-2258b0af271f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:26.372709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-98d785f5-7ba2-4d07-9729-8bb8d23a5570 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.373338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-764c29bf-cd9e-43cc-9951-2258b0af271f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:26.374083 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-764c29bf-cd9e-43cc-9951-2258b0af271f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.375054 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-764c29bf-cd9e-43cc-9951-2258b0af271f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:26.375715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-764c29bf-cd9e-43cc-9951-2258b0af271f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:26.376359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-764c29bf-cd9e-43cc-9951-2258b0af271f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.583670 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-98d785f5-7ba2-4d07-9729-8bb8d23a5570 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:26.587551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-764c29bf-cd9e-43cc-9951-2258b0af271f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:26.598066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-764c29bf-cd9e-43cc-9951-2258b0af271f tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.238034 Aug 10 23:14:26.611451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 82/160] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:26 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:26.611636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-98d785f5-7ba2-4d07-9729-8bb8d23a5570 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.241262 Aug 10 23:14:26.611636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 79/161] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:26 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:27.198671 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e17bf999-9c6d-4def-af31-88da2d8c160d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:27.199322 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e17bf999-9c6d-4def-af31-88da2d8c160d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:27.205464 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17bf999-9c6d-4def-af31-88da2d8c160d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.205948 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17bf999-9c6d-4def-af31-88da2d8c160d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.206383 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17bf999-9c6d-4def-af31-88da2d8c160d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.207115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17bf999-9c6d-4def-af31-88da2d8c160d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.207570 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17bf999-9c6d-4def-af31-88da2d8c160d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.207997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17bf999-9c6d-4def-af31-88da2d8c160d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.277102 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:27.277707 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:27.283813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.284481 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.285061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.287238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.288039 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.288490 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.307238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=100 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:27.376426 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e17bf999-9c6d-4def-af31-88da2d8c160d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:27.386587 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e17bf999-9c6d-4def-af31-88da2d8c160d tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.191808 Aug 10 23:14:27.401284 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 83/162] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:27 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:27.449230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:27.457351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:27.458949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:27.460051 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-321dbdeb-2c88-4895-81a4-64519d0e88ef tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.187398 Aug 10 23:14:27.460744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 80/163] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:27 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:27.620843 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-51dc5927-1c4e-4c5e-bacb-d0d539f8fd24 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:27.621468 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-51dc5927-1c4e-4c5e-bacb-d0d539f8fd24 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:27.624791 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2a57b67e-6cac-4066-bfdb-49eb9351012f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:27.626141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2a57b67e-6cac-4066-bfdb-49eb9351012f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:27.631371 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51dc5927-1c4e-4c5e-bacb-d0d539f8fd24 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.631872 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51dc5927-1c4e-4c5e-bacb-d0d539f8fd24 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.632308 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51dc5927-1c4e-4c5e-bacb-d0d539f8fd24 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.633188 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51dc5927-1c4e-4c5e-bacb-d0d539f8fd24 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.633653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51dc5927-1c4e-4c5e-bacb-d0d539f8fd24 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.634083 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51dc5927-1c4e-4c5e-bacb-d0d539f8fd24 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.641888 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a57b67e-6cac-4066-bfdb-49eb9351012f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.642488 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a57b67e-6cac-4066-bfdb-49eb9351012f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.645675 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a57b67e-6cac-4066-bfdb-49eb9351012f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.646968 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a57b67e-6cac-4066-bfdb-49eb9351012f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.647822 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a57b67e-6cac-4066-bfdb-49eb9351012f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.649595 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a57b67e-6cac-4066-bfdb-49eb9351012f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.012259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-51dc5927-1c4e-4c5e-bacb-d0d539f8fd24 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.020173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-51dc5927-1c4e-4c5e-bacb-d0d539f8fd24 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1315 microversion: 2.1 time: 0.403624 Aug 10 23:14:28.021256 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 84/164] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:27 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:28.037080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-388709ed-adec-47d9-9032-55d6d7dd528b req-323e70a3-cfd3-4e0e-9c6b-65aea21488a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7ea374-a02e-4bdc-a8ed-02453f7dcc66", "name": "network-vif-plugged", "status": "completed", "tag": "e7890e54-55df-4695-9a95-9f617e451cc1"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:28.053033 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2a57b67e-6cac-4066-bfdb-49eb9351012f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.060950 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-388709ed-adec-47d9-9032-55d6d7dd528b req-323e70a3-cfd3-4e0e-9c6b-65aea21488a6 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.061431 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-388709ed-adec-47d9-9032-55d6d7dd528b req-323e70a3-cfd3-4e0e-9c6b-65aea21488a6 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.061863 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-388709ed-adec-47d9-9032-55d6d7dd528b req-323e70a3-cfd3-4e0e-9c6b-65aea21488a6 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.067163 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2a57b67e-6cac-4066-bfdb-49eb9351012f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1321 microversion: 2.1 time: 0.449391 Aug 10 23:14:28.067904 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 81/165] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:27 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:28.082144 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-388709ed-adec-47d9-9032-55d6d7dd528b req-323e70a3-cfd3-4e0e-9c6b-65aea21488a6 service nova] Creating event network-vif-plugged:e7890e54-55df-4695-9a95-9f617e451cc1 for instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 on hv-cinder-85144 Aug 10 23:14:28.088061 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-388709ed-adec-47d9-9032-55d6d7dd528b req-323e70a3-cfd3-4e0e-9c6b-65aea21488a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064947 Aug 10 23:14:28.089110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 85/166] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:28.409142 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4c66cafd-cc72-4589-9700-ab3f6b87d1bc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:28.409759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4c66cafd-cc72-4589-9700-ab3f6b87d1bc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:28.420657 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c66cafd-cc72-4589-9700-ab3f6b87d1bc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.421368 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c66cafd-cc72-4589-9700-ab3f6b87d1bc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.422081 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c66cafd-cc72-4589-9700-ab3f6b87d1bc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.422994 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c66cafd-cc72-4589-9700-ab3f6b87d1bc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.423617 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c66cafd-cc72-4589-9700-ab3f6b87d1bc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.425961 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c66cafd-cc72-4589-9700-ab3f6b87d1bc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.484908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:28.485610 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:28.492663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.493281 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.493979 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.494725 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.495182 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.495662 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.763112 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4c66cafd-cc72-4589-9700-ab3f6b87d1bc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.763112 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4c66cafd-cc72-4589-9700-ab3f6b87d1bc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.251537 Aug 10 23:14:28.763112 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 82/167] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:28 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:28.763535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.763535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.763852 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.763852 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e8e9cfbd-ec9b-46c0-abbc-1dfa1cc3f6a6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.212147 Aug 10 23:14:28.763852 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 86/168] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:28 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:29.044653 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9a840002-fdff-44ff-a6c7-6617eb687240 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:29.045786 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9a840002-fdff-44ff-a6c7-6617eb687240 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:29.052030 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a840002-fdff-44ff-a6c7-6617eb687240 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.052592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a840002-fdff-44ff-a6c7-6617eb687240 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.053082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a840002-fdff-44ff-a6c7-6617eb687240 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.053851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a840002-fdff-44ff-a6c7-6617eb687240 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.054382 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a840002-fdff-44ff-a6c7-6617eb687240 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.055098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a840002-fdff-44ff-a6c7-6617eb687240 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.090306 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8261a0a2-6cee-4973-9460-1567dcceee09 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:29.091236 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8261a0a2-6cee-4973-9460-1567dcceee09 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:29.100193 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8261a0a2-6cee-4973-9460-1567dcceee09 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.100930 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8261a0a2-6cee-4973-9460-1567dcceee09 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.101539 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8261a0a2-6cee-4973-9460-1567dcceee09 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.102637 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8261a0a2-6cee-4973-9460-1567dcceee09 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.107947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8261a0a2-6cee-4973-9460-1567dcceee09 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.107947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8261a0a2-6cee-4973-9460-1567dcceee09 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.267107 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-9a840002-fdff-44ff-a6c7-6617eb687240 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:29.276423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9a840002-fdff-44ff-a6c7-6617eb687240 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1502 microversion: 2.1 time: 0.235949 Aug 10 23:14:29.281949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 83/169] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:29 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1502 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:29.311682 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8261a0a2-6cee-4973-9460-1567dcceee09 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:29.319647 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8261a0a2-6cee-4973-9460-1567dcceee09 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1515 microversion: 2.1 time: 0.233217 Aug 10 23:14:29.322202 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 87/170] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:29 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:29.341673 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-717d14c2-638d-4e62-8da7-589ca80c9206 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:29.343632 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-717d14c2-638d-4e62-8da7-589ca80c9206 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:29.350551 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-717d14c2-638d-4e62-8da7-589ca80c9206 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.351209 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-717d14c2-638d-4e62-8da7-589ca80c9206 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.351662 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-717d14c2-638d-4e62-8da7-589ca80c9206 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.352372 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-717d14c2-638d-4e62-8da7-589ca80c9206 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.353573 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-717d14c2-638d-4e62-8da7-589ca80c9206 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.354266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-717d14c2-638d-4e62-8da7-589ca80c9206 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.431375 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-717d14c2-638d-4e62-8da7-589ca80c9206 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lazy-loading 'flavor' on Instance uuid e3a85987-a755-456a-9d00-0992cbe4368a {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:14:29.767557 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:29.769722 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:29.792426 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.799979 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.800529 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.801357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.801921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.802415 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.879141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-717d14c2-638d-4e62-8da7-589ca80c9206 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a/action" status: 200 len: 32 microversion: 2.1 time: 0.542044 Aug 10 23:14:29.882024 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 84/171] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:29 2022] POST /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a/action => generated 32 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:14:29.887604 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ab21a97b-27f7-46fa-b9c7-183131d0255e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:29.888760 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ab21a97b-27f7-46fa-b9c7-183131d0255e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:29.898024 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ab21a97b-27f7-46fa-b9c7-183131d0255e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.899305 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ab21a97b-27f7-46fa-b9c7-183131d0255e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.900130 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ab21a97b-27f7-46fa-b9c7-183131d0255e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.901217 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ab21a97b-27f7-46fa-b9c7-183131d0255e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.902682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ab21a97b-27f7-46fa-b9c7-183131d0255e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.906169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ab21a97b-27f7-46fa-b9c7-183131d0255e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:30.112975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:30.127323 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:30.129135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:30.130571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-14240a94-988b-4597-b245-fa17eb309f5b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.367047 Aug 10 23:14:30.132079 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 88/172] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:29 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:30.137828 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-10bd2b93-f1c9-4ebe-9ddd-bc38524beef6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:30.138723 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-10bd2b93-f1c9-4ebe-9ddd-bc38524beef6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:30.148730 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10bd2b93-f1c9-4ebe-9ddd-bc38524beef6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:30.149223 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10bd2b93-f1c9-4ebe-9ddd-bc38524beef6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:30.149660 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10bd2b93-f1c9-4ebe-9ddd-bc38524beef6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:30.150619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10bd2b93-f1c9-4ebe-9ddd-bc38524beef6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:30.151123 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10bd2b93-f1c9-4ebe-9ddd-bc38524beef6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:30.151826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10bd2b93-f1c9-4ebe-9ddd-bc38524beef6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:30.182917 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ab21a97b-27f7-46fa-b9c7-183131d0255e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:30.191264 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ab21a97b-27f7-46fa-b9c7-183131d0255e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1367 microversion: 2.1 time: 0.309706 Aug 10 23:14:30.191843 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 85/173] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:29 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:30.196506 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-08d29f76-b0f8-487e-8157-02d98dfdd5c4 req-869731de-5e92-4751-ac47-4eafc6771e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d062824b-f7a6-4380-a622-5bba74816355", "name": "network-vif-plugged", "status": "completed", "tag": "6056ee81-d58a-4644-a5ae-8077d23b8e92"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:30.206947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-08d29f76-b0f8-487e-8157-02d98dfdd5c4 req-869731de-5e92-4751-ac47-4eafc6771e5c service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:30.207705 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-08d29f76-b0f8-487e-8157-02d98dfdd5c4 req-869731de-5e92-4751-ac47-4eafc6771e5c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:30.208381 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-08d29f76-b0f8-487e-8157-02d98dfdd5c4 req-869731de-5e92-4751-ac47-4eafc6771e5c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:30.232520 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-08d29f76-b0f8-487e-8157-02d98dfdd5c4 req-869731de-5e92-4751-ac47-4eafc6771e5c service nova] Creating event network-vif-plugged:6056ee81-d58a-4644-a5ae-8077d23b8e92 for instance d062824b-f7a6-4380-a622-5bba74816355 on hv-cinder-85144 Aug 10 23:14:30.237987 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-08d29f76-b0f8-487e-8157-02d98dfdd5c4 req-869731de-5e92-4751-ac47-4eafc6771e5c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044792 Aug 10 23:14:30.238793 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 86/174] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:30.327517 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-10bd2b93-f1c9-4ebe-9ddd-bc38524beef6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:30.335235 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-10bd2b93-f1c9-4ebe-9ddd-bc38524beef6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.201850 Aug 10 23:14:30.335833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 89/175] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:30 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:31.155296 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:31.156237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:31.162260 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.162962 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.163396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.164077 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.164649 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.165208 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.216034 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7c63f2e5-46a1-4080-97cd-dd5bbc043a95 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:31.216645 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7c63f2e5-46a1-4080-97cd-dd5bbc043a95 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:31.222920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c63f2e5-46a1-4080-97cd-dd5bbc043a95 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.223403 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c63f2e5-46a1-4080-97cd-dd5bbc043a95 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.223894 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c63f2e5-46a1-4080-97cd-dd5bbc043a95 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.224740 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c63f2e5-46a1-4080-97cd-dd5bbc043a95 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.225199 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c63f2e5-46a1-4080-97cd-dd5bbc043a95 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.225623 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7c63f2e5-46a1-4080-97cd-dd5bbc043a95 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.460998 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.485226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.488842 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.492111 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-539a59c6-0c06-4f99-8fe6-226a8bbbbc7c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.341815 Aug 10 23:14:31.498304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 87/176] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:31 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:31.507018 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-28eeb7af-59f6-4f5d-b106-9d90a755c7f1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:31.507018 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-28eeb7af-59f6-4f5d-b106-9d90a755c7f1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:31.518467 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28eeb7af-59f6-4f5d-b106-9d90a755c7f1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.519865 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28eeb7af-59f6-4f5d-b106-9d90a755c7f1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.522426 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28eeb7af-59f6-4f5d-b106-9d90a755c7f1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.523595 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28eeb7af-59f6-4f5d-b106-9d90a755c7f1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.526708 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28eeb7af-59f6-4f5d-b106-9d90a755c7f1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.529255 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-28eeb7af-59f6-4f5d-b106-9d90a755c7f1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.569712 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7c63f2e5-46a1-4080-97cd-dd5bbc043a95 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.576805 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7c63f2e5-46a1-4080-97cd-dd5bbc043a95 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1557 microversion: 2.1 time: 0.365257 Aug 10 23:14:31.596116 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 90/177] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:31 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1557 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:31.605862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a6b1d873-91c7-4a86-b30e-3edddaa4af21 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:31.617735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a6b1d873-91c7-4a86-b30e-3edddaa4af21 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:31.617735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6b1d873-91c7-4a86-b30e-3edddaa4af21 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.617735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6b1d873-91c7-4a86-b30e-3edddaa4af21 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.617735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6b1d873-91c7-4a86-b30e-3edddaa4af21 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.619251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6b1d873-91c7-4a86-b30e-3edddaa4af21 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.619251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6b1d873-91c7-4a86-b30e-3edddaa4af21 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.619251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6b1d873-91c7-4a86-b30e-3edddaa4af21 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.824077 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a6b1d873-91c7-4a86-b30e-3edddaa4af21 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.224315 Aug 10 23:14:31.834304 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 91/178] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 10 23:14:31 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:14:31.863557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-28eeb7af-59f6-4f5d-b106-9d90a755c7f1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.872201 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-28eeb7af-59f6-4f5d-b106-9d90a755c7f1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.372555 Aug 10 23:14:31.872769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 88/179] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:31 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:32.532969 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:32.533659 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:32.544121 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.544735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.558600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:32.558600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.558600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.558600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:32.665304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-bfbb25f4-c83c-4271-a67f-e39437822611 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e3dbd04-f3ef-4ccc-acc2-9b78f7160ec6"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:32.669986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bfbb25f4-c83c-4271-a67f-e39437822611 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:32.676096 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfbb25f4-c83c-4271-a67f-e39437822611 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.676649 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfbb25f4-c83c-4271-a67f-e39437822611 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.677254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfbb25f4-c83c-4271-a67f-e39437822611 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:32.678029 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfbb25f4-c83c-4271-a67f-e39437822611 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.678494 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfbb25f4-c83c-4271-a67f-e39437822611 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.678974 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfbb25f4-c83c-4271-a67f-e39437822611 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:32.703647 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:32.715886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:32.717874 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:32.719222 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f20a7aae-68b6-48b5-b9f7-29ba8103e3c8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.190560 Aug 10 23:14:32.719814 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 92/180] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:32 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:32.893738 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-386a9a4c-db6c-4459-add8-2cabfd0621da tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:32.894348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-386a9a4c-db6c-4459-add8-2cabfd0621da tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:32.900439 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-386a9a4c-db6c-4459-add8-2cabfd0621da tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.901022 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-386a9a4c-db6c-4459-add8-2cabfd0621da tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.901458 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-386a9a4c-db6c-4459-add8-2cabfd0621da tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:32.902152 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-386a9a4c-db6c-4459-add8-2cabfd0621da tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.902600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-386a9a4c-db6c-4459-add8-2cabfd0621da tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.903046 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-386a9a4c-db6c-4459-add8-2cabfd0621da tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:33.104151 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-386a9a4c-db6c-4459-add8-2cabfd0621da tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:33.122837 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-386a9a4c-db6c-4459-add8-2cabfd0621da tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.233231 Aug 10 23:14:33.124243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 93/181] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:32 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:33.523404 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-567d51b9-f934-487c-b926-e52dbb334c8a req-5ef52716-a4c0-4e7c-a643-809008269908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d", "tag": "c83fa2ce-f061-4547-9cb4-a740a906feac"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:33.534828 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-567d51b9-f934-487c-b926-e52dbb334c8a req-5ef52716-a4c0-4e7c-a643-809008269908 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:33.536337 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-567d51b9-f934-487c-b926-e52dbb334c8a req-5ef52716-a4c0-4e7c-a643-809008269908 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:33.537107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-567d51b9-f934-487c-b926-e52dbb334c8a req-5ef52716-a4c0-4e7c-a643-809008269908 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:33.549433 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-567d51b9-f934-487c-b926-e52dbb334c8a req-5ef52716-a4c0-4e7c-a643-809008269908 service nova] Creating event network-changed:c83fa2ce-f061-4547-9cb4-a740a906feac for instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d on hv-cinder-85144 Aug 10 23:14:33.554806 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-567d51b9-f934-487c-b926-e52dbb334c8a req-5ef52716-a4c0-4e7c-a643-809008269908 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035427 Aug 10 23:14:33.555412 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 94/182] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:14:33.754033 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:33.754777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:33.772735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:33.773236 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:33.773678 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:33.774401 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:33.778696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:33.779197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.103999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.106633 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-bfbb25f4-c83c-4271-a67f-e39437822611 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "POST /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.446678 Aug 10 23:14:34.108256 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 89/183] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:14:32 2022] POST /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3/os-volume_attachments => generated 194 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:34.121944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.126285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.130647 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1e2c9767-b711-40c6-9928-4fbfddc6878d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1408 microversion: 2.20 time: 0.386703 Aug 10 23:14:34.147999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 95/184] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:33 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1408 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:34.157489 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-79e4d020-5ca2-4a01-b8f9-99393f6bdcf1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:34.158197 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-79e4d020-5ca2-4a01-b8f9-99393f6bdcf1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:34.171099 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79e4d020-5ca2-4a01-b8f9-99393f6bdcf1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.171600 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79e4d020-5ca2-4a01-b8f9-99393f6bdcf1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.172568 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79e4d020-5ca2-4a01-b8f9-99393f6bdcf1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.173299 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79e4d020-5ca2-4a01-b8f9-99393f6bdcf1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.173765 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79e4d020-5ca2-4a01-b8f9-99393f6bdcf1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.174200 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79e4d020-5ca2-4a01-b8f9-99393f6bdcf1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.503892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-79e4d020-5ca2-4a01-b8f9-99393f6bdcf1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.528737 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-79e4d020-5ca2-4a01-b8f9-99393f6bdcf1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.359816 Aug 10 23:14:34.528737 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 90/185] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:34 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:35.157293 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:35.157909 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:35.166035 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:35.166641 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.167103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.167825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:35.168284 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.168775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.318528 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:35.326916 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:35.328497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:35.329675 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-459d8441-ccd1-4b01-a4ba-31420fb9cd54 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1600 microversion: 2.20 time: 0.176265 Aug 10 23:14:35.330223 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 96/186] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:35 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:35.354474 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5b1b6680-4cf7-4013-b012-4eed9b82b95e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:35.354998 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5b1b6680-4cf7-4013-b012-4eed9b82b95e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:35.361563 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b1b6680-4cf7-4013-b012-4eed9b82b95e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:35.362049 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b1b6680-4cf7-4013-b012-4eed9b82b95e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.362730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b1b6680-4cf7-4013-b012-4eed9b82b95e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.363442 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b1b6680-4cf7-4013-b012-4eed9b82b95e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:35.363902 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b1b6680-4cf7-4013-b012-4eed9b82b95e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.364329 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b1b6680-4cf7-4013-b012-4eed9b82b95e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.444668 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5b1b6680-4cf7-4013-b012-4eed9b82b95e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094700 Aug 10 23:14:35.445332 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 91/187] 10.222.0.78 () {60 vars in 1316 bytes} [Wed Aug 10 23:14:35 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:14:35.548567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3770766c-07e6-4a8b-b6c2-5e72290fba5a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:35.549741 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3770766c-07e6-4a8b-b6c2-5e72290fba5a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:35.557307 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3770766c-07e6-4a8b-b6c2-5e72290fba5a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:35.562289 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3770766c-07e6-4a8b-b6c2-5e72290fba5a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.562289 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3770766c-07e6-4a8b-b6c2-5e72290fba5a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.562289 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3770766c-07e6-4a8b-b6c2-5e72290fba5a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:35.562289 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3770766c-07e6-4a8b-b6c2-5e72290fba5a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.562952 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3770766c-07e6-4a8b-b6c2-5e72290fba5a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.844163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3770766c-07e6-4a8b-b6c2-5e72290fba5a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:35.848570 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=100 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:35.853095 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3770766c-07e6-4a8b-b6c2-5e72290fba5a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.309155 Aug 10 23:14:35.853942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 97/188] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:35 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:36.879226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9eda8308-f488-40b0-a850-59aff6206a6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:36.881005 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9eda8308-f488-40b0-a850-59aff6206a6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:36.890139 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9eda8308-f488-40b0-a850-59aff6206a6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.890695 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9eda8308-f488-40b0-a850-59aff6206a6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.891115 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9eda8308-f488-40b0-a850-59aff6206a6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.896978 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9eda8308-f488-40b0-a850-59aff6206a6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.896978 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9eda8308-f488-40b0-a850-59aff6206a6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.896978 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9eda8308-f488-40b0-a850-59aff6206a6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.290824 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-3368ae03-554e-4987-aac3-985c0932dea1 req-26012161-3eb7-4e51-b8c2-7c53f143c80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d062824b-f7a6-4380-a622-5bba74816355", "tag": "6056ee81-d58a-4644-a5ae-8077d23b8e92"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:37.305615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-9eda8308-f488-40b0-a850-59aff6206a6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:37.314389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9eda8308-f488-40b0-a850-59aff6206a6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.442439 Aug 10 23:14:37.315251 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 92/189] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:36 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:37.316882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-3368ae03-554e-4987-aac3-985c0932dea1 req-26012161-3eb7-4e51-b8c2-7c53f143c80a service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.317676 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-3368ae03-554e-4987-aac3-985c0932dea1 req-26012161-3eb7-4e51-b8c2-7c53f143c80a service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.318209 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-3368ae03-554e-4987-aac3-985c0932dea1 req-26012161-3eb7-4e51-b8c2-7c53f143c80a service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.334781 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-3368ae03-554e-4987-aac3-985c0932dea1 req-26012161-3eb7-4e51-b8c2-7c53f143c80a service nova] Creating event network-changed:6056ee81-d58a-4644-a5ae-8077d23b8e92 for instance d062824b-f7a6-4380-a622-5bba74816355 on hv-cinder-85144 Aug 10 23:14:37.340500 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-3368ae03-554e-4987-aac3-985c0932dea1 req-26012161-3eb7-4e51-b8c2-7c53f143c80a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055936 Aug 10 23:14:37.341093 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 98/190] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:14:38.336605 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2e9d1671-50c7-4538-b8cc-414b092578b3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:38.337833 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2e9d1671-50c7-4538-b8cc-414b092578b3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:38.344608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e9d1671-50c7-4538-b8cc-414b092578b3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:38.345092 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e9d1671-50c7-4538-b8cc-414b092578b3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:38.345787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e9d1671-50c7-4538-b8cc-414b092578b3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:38.346480 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e9d1671-50c7-4538-b8cc-414b092578b3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:38.346958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e9d1671-50c7-4538-b8cc-414b092578b3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:38.347378 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e9d1671-50c7-4538-b8cc-414b092578b3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:38.510635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2e9d1671-50c7-4538-b8cc-414b092578b3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:38.520768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2e9d1671-50c7-4538-b8cc-414b092578b3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.187899 Aug 10 23:14:38.535036 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 93/191] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:38 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:39.547381 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-27d21691-11bd-4a52-bf41-d6ee3d76bac4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:39.547381 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-27d21691-11bd-4a52-bf41-d6ee3d76bac4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:39.554742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-27d21691-11bd-4a52-bf41-d6ee3d76bac4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.555427 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-27d21691-11bd-4a52-bf41-d6ee3d76bac4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.556671 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-27d21691-11bd-4a52-bf41-d6ee3d76bac4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.557397 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-27d21691-11bd-4a52-bf41-d6ee3d76bac4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.557849 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-27d21691-11bd-4a52-bf41-d6ee3d76bac4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.558279 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-27d21691-11bd-4a52-bf41-d6ee3d76bac4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.709416 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-27d21691-11bd-4a52-bf41-d6ee3d76bac4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:39.717237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-27d21691-11bd-4a52-bf41-d6ee3d76bac4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.176509 Aug 10 23:14:39.717799 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 99/192] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:39 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:40.738057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-073eb7b9-7d45-4704-a45a-8a0756d73b84 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:40.740928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-073eb7b9-7d45-4704-a45a-8a0756d73b84 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:40.751339 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-073eb7b9-7d45-4704-a45a-8a0756d73b84 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:40.751845 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-073eb7b9-7d45-4704-a45a-8a0756d73b84 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:40.752284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-073eb7b9-7d45-4704-a45a-8a0756d73b84 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:40.752980 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-073eb7b9-7d45-4704-a45a-8a0756d73b84 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:40.753440 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-073eb7b9-7d45-4704-a45a-8a0756d73b84 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:40.753865 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-073eb7b9-7d45-4704-a45a-8a0756d73b84 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:40.888816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-073eb7b9-7d45-4704-a45a-8a0756d73b84 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:40.892584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:40.896980 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-073eb7b9-7d45-4704-a45a-8a0756d73b84 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.162743 Aug 10 23:14:40.897777 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 94/193] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:40 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:41.918918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-05337319-460e-4165-8c8f-3386a1fa4cf2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:41.919701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-05337319-460e-4165-8c8f-3386a1fa4cf2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:41.926899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05337319-460e-4165-8c8f-3386a1fa4cf2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.927504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05337319-460e-4165-8c8f-3386a1fa4cf2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.928293 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05337319-460e-4165-8c8f-3386a1fa4cf2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.929193 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05337319-460e-4165-8c8f-3386a1fa4cf2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.929711 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05337319-460e-4165-8c8f-3386a1fa4cf2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.930147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05337319-460e-4165-8c8f-3386a1fa4cf2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:42.077680 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-05337319-460e-4165-8c8f-3386a1fa4cf2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:42.085270 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-05337319-460e-4165-8c8f-3386a1fa4cf2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.171371 Aug 10 23:14:42.085773 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 100/194] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:41 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:43.106373 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3b95146a-28b3-46d2-9f90-6b30c7180a05 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:43.107094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3b95146a-28b3-46d2-9f90-6b30c7180a05 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:43.114250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b95146a-28b3-46d2-9f90-6b30c7180a05 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.114847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b95146a-28b3-46d2-9f90-6b30c7180a05 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.115361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b95146a-28b3-46d2-9f90-6b30c7180a05 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.116159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b95146a-28b3-46d2-9f90-6b30c7180a05 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.116707 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b95146a-28b3-46d2-9f90-6b30c7180a05 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.117140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b95146a-28b3-46d2-9f90-6b30c7180a05 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.254684 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3b95146a-28b3-46d2-9f90-6b30c7180a05 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:43.262905 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3b95146a-28b3-46d2-9f90-6b30c7180a05 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.161328 Aug 10 23:14:43.263506 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 95/195] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:43 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:44.283759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-535bc919-3300-4788-b098-e28bec4cb55c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:44.284600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-535bc919-3300-4788-b098-e28bec4cb55c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:44.291436 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-535bc919-3300-4788-b098-e28bec4cb55c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.291915 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-535bc919-3300-4788-b098-e28bec4cb55c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.292349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-535bc919-3300-4788-b098-e28bec4cb55c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.293046 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-535bc919-3300-4788-b098-e28bec4cb55c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.293497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-535bc919-3300-4788-b098-e28bec4cb55c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.293956 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-535bc919-3300-4788-b098-e28bec4cb55c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.435944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-535bc919-3300-4788-b098-e28bec4cb55c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:44.444574 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-535bc919-3300-4788-b098-e28bec4cb55c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.164686 Aug 10 23:14:44.445286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 101/196] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:44 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:45.467677 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0fab9688-5ed2-49a3-85bf-32431237fb36 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:45.468374 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0fab9688-5ed2-49a3-85bf-32431237fb36 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:45.475931 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fab9688-5ed2-49a3-85bf-32431237fb36 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.476496 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fab9688-5ed2-49a3-85bf-32431237fb36 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.477067 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fab9688-5ed2-49a3-85bf-32431237fb36 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.478294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fab9688-5ed2-49a3-85bf-32431237fb36 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.478856 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fab9688-5ed2-49a3-85bf-32431237fb36 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.479290 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fab9688-5ed2-49a3-85bf-32431237fb36 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.611309 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0fab9688-5ed2-49a3-85bf-32431237fb36 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:45.619451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0fab9688-5ed2-49a3-85bf-32431237fb36 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.155990 Aug 10 23:14:45.619915 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 96/197] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:45 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:46.640467 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5a229ced-871f-4518-b98a-5713f9096a7a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:46.641125 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5a229ced-871f-4518-b98a-5713f9096a7a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:46.647624 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a229ced-871f-4518-b98a-5713f9096a7a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.648103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a229ced-871f-4518-b98a-5713f9096a7a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.648556 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a229ced-871f-4518-b98a-5713f9096a7a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.649324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a229ced-871f-4518-b98a-5713f9096a7a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.650283 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a229ced-871f-4518-b98a-5713f9096a7a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.650730 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5a229ced-871f-4518-b98a-5713f9096a7a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.783504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5a229ced-871f-4518-b98a-5713f9096a7a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:46.790947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5a229ced-871f-4518-b98a-5713f9096a7a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.154247 Aug 10 23:14:46.791520 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 102/198] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:46 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:47.817750 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-900f39d7-a905-4548-b07c-14ea9dc148d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:47.817750 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-900f39d7-a905-4548-b07c-14ea9dc148d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:47.820048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-900f39d7-a905-4548-b07c-14ea9dc148d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.820534 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-900f39d7-a905-4548-b07c-14ea9dc148d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.820969 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-900f39d7-a905-4548-b07c-14ea9dc148d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.822186 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-900f39d7-a905-4548-b07c-14ea9dc148d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.822636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-900f39d7-a905-4548-b07c-14ea9dc148d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.823099 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-900f39d7-a905-4548-b07c-14ea9dc148d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.967198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-900f39d7-a905-4548-b07c-14ea9dc148d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:47.974979 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-900f39d7-a905-4548-b07c-14ea9dc148d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.166488 Aug 10 23:14:47.975543 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 97/199] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:47 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:48.995850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-60189cf3-dd19-495b-8fcd-9abda21054f7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:48.996446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-60189cf3-dd19-495b-8fcd-9abda21054f7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:49.002318 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60189cf3-dd19-495b-8fcd-9abda21054f7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:49.002830 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60189cf3-dd19-495b-8fcd-9abda21054f7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:49.003268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60189cf3-dd19-495b-8fcd-9abda21054f7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:49.003957 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60189cf3-dd19-495b-8fcd-9abda21054f7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:49.004404 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60189cf3-dd19-495b-8fcd-9abda21054f7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:49.004825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-60189cf3-dd19-495b-8fcd-9abda21054f7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:49.142257 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-60189cf3-dd19-495b-8fcd-9abda21054f7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:49.150532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-60189cf3-dd19-495b-8fcd-9abda21054f7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.158636 Aug 10 23:14:49.153244 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 103/200] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:48 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:49.775756 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0e541e6d-3284-45b1-b5f9-9664b055b16b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:49.776328 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0e541e6d-3284-45b1-b5f9-9664b055b16b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:49.782626 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0e541e6d-3284-45b1-b5f9-9664b055b16b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:49.783140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0e541e6d-3284-45b1-b5f9-9664b055b16b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:49.783579 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0e541e6d-3284-45b1-b5f9-9664b055b16b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:49.784274 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0e541e6d-3284-45b1-b5f9-9664b055b16b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:49.784734 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0e541e6d-3284-45b1-b5f9-9664b055b16b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:49.785161 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0e541e6d-3284-45b1-b5f9-9664b055b16b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:49.812926 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0e541e6d-3284-45b1-b5f9-9664b055b16b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:14:50.162302 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0e541e6d-3284-45b1-b5f9-9664b055b16b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 204 len: 0 microversion: 2.1 time: 0.390173 Aug 10 23:14:50.162916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 98/201] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:14:49 2022] DELETE /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:14:50.171178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f8a0af2e-d63a-4a88-8f9d-a1da9f28dbe3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:50.177887 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f8a0af2e-d63a-4a88-8f9d-a1da9f28dbe3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:50.178014 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-213bfff6-db07-4cc5-8474-71c907c8f536 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:50.178014 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-213bfff6-db07-4cc5-8474-71c907c8f536 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:50.178409 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8a0af2e-d63a-4a88-8f9d-a1da9f28dbe3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.178814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-213bfff6-db07-4cc5-8474-71c907c8f536 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.178978 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8a0af2e-d63a-4a88-8f9d-a1da9f28dbe3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.179335 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8a0af2e-d63a-4a88-8f9d-a1da9f28dbe3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.179609 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-213bfff6-db07-4cc5-8474-71c907c8f536 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.180023 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8a0af2e-d63a-4a88-8f9d-a1da9f28dbe3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.180144 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-213bfff6-db07-4cc5-8474-71c907c8f536 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.180469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8a0af2e-d63a-4a88-8f9d-a1da9f28dbe3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.181276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-213bfff6-db07-4cc5-8474-71c907c8f536 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.181442 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8a0af2e-d63a-4a88-8f9d-a1da9f28dbe3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.181740 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-213bfff6-db07-4cc5-8474-71c907c8f536 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.182173 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-213bfff6-db07-4cc5-8474-71c907c8f536 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.379681 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f8a0af2e-d63a-4a88-8f9d-a1da9f28dbe3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:50.383120 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-213bfff6-db07-4cc5-8474-71c907c8f536 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:50.386921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f8a0af2e-d63a-4a88-8f9d-a1da9f28dbe3 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.219414 Aug 10 23:14:50.387499 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 104/202] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:50 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:50.390590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-213bfff6-db07-4cc5-8474-71c907c8f536 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.223084 Aug 10 23:14:50.391226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 99/203] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:50 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:51.409521 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-21313e21-cf33-4942-8cc2-20f9cbfe6af2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:51.410126 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-21313e21-cf33-4942-8cc2-20f9cbfe6af2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:51.416882 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-46f27a1d-9891-4c79-9136-bab157286da7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:51.417743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-46f27a1d-9891-4c79-9136-bab157286da7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:51.420701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21313e21-cf33-4942-8cc2-20f9cbfe6af2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:51.421187 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21313e21-cf33-4942-8cc2-20f9cbfe6af2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:51.421789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21313e21-cf33-4942-8cc2-20f9cbfe6af2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:51.422493 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21313e21-cf33-4942-8cc2-20f9cbfe6af2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:51.422967 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21313e21-cf33-4942-8cc2-20f9cbfe6af2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:51.423388 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21313e21-cf33-4942-8cc2-20f9cbfe6af2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:51.425306 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-46f27a1d-9891-4c79-9136-bab157286da7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:51.425876 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-46f27a1d-9891-4c79-9136-bab157286da7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:51.426551 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-46f27a1d-9891-4c79-9136-bab157286da7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:51.427929 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-46f27a1d-9891-4c79-9136-bab157286da7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:51.428606 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-46f27a1d-9891-4c79-9136-bab157286da7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:51.429397 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-46f27a1d-9891-4c79-9136-bab157286da7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:51.637298 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-21313e21-cf33-4942-8cc2-20f9cbfe6af2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:51.640291 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-46f27a1d-9891-4c79-9136-bab157286da7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:51.645705 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-21313e21-cf33-4942-8cc2-20f9cbfe6af2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.240131 Aug 10 23:14:51.652686 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 105/204] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:51 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:51.652812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-46f27a1d-9891-4c79-9136-bab157286da7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.235188 Aug 10 23:14:51.652812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 100/205] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:51 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:52.666252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3225d0ea-fbee-4605-9399-1e4740db4ac1 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:52.666890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3225d0ea-fbee-4605-9399-1e4740db4ac1 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:52.669164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e05d2c82-c286-49dc-bf73-7ce83fa74cec tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:52.669867 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e05d2c82-c286-49dc-bf73-7ce83fa74cec tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:52.672912 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3225d0ea-fbee-4605-9399-1e4740db4ac1 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:52.673386 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3225d0ea-fbee-4605-9399-1e4740db4ac1 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:52.673964 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3225d0ea-fbee-4605-9399-1e4740db4ac1 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:52.674681 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3225d0ea-fbee-4605-9399-1e4740db4ac1 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:52.675129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3225d0ea-fbee-4605-9399-1e4740db4ac1 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:52.675628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3225d0ea-fbee-4605-9399-1e4740db4ac1 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:52.676236 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e05d2c82-c286-49dc-bf73-7ce83fa74cec tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:52.676720 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e05d2c82-c286-49dc-bf73-7ce83fa74cec tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:52.677197 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e05d2c82-c286-49dc-bf73-7ce83fa74cec tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:52.677862 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e05d2c82-c286-49dc-bf73-7ce83fa74cec tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:52.678315 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e05d2c82-c286-49dc-bf73-7ce83fa74cec tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:52.678766 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e05d2c82-c286-49dc-bf73-7ce83fa74cec tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:52.865759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3225d0ea-fbee-4605-9399-1e4740db4ac1 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:52.874693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3225d0ea-fbee-4605-9399-1e4740db4ac1 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.212556 Aug 10 23:14:52.875309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 106/206] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:52 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:52.886826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e05d2c82-c286-49dc-bf73-7ce83fa74cec tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:52.888370 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e05d2c82-c286-49dc-bf73-7ce83fa74cec tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.223310 Aug 10 23:14:52.888947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 101/207] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:52 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:53.896149 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-31ad9d1f-5f0f-4ba3-9146-b0de714deb10 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:53.897002 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-31ad9d1f-5f0f-4ba3-9146-b0de714deb10 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:53.903180 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31ad9d1f-5f0f-4ba3-9146-b0de714deb10 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.903663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31ad9d1f-5f0f-4ba3-9146-b0de714deb10 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.904176 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31ad9d1f-5f0f-4ba3-9146-b0de714deb10 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:53.904886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31ad9d1f-5f0f-4ba3-9146-b0de714deb10 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.905340 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31ad9d1f-5f0f-4ba3-9146-b0de714deb10 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.905770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31ad9d1f-5f0f-4ba3-9146-b0de714deb10 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:53.909050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5d38c5bf-830e-4ab9-a421-c0dc619a534d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:53.909656 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5d38c5bf-830e-4ab9-a421-c0dc619a534d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:53.916671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5d38c5bf-830e-4ab9-a421-c0dc619a534d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.917146 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5d38c5bf-830e-4ab9-a421-c0dc619a534d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.917573 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5d38c5bf-830e-4ab9-a421-c0dc619a534d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:53.918262 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5d38c5bf-830e-4ab9-a421-c0dc619a534d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.918745 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5d38c5bf-830e-4ab9-a421-c0dc619a534d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.919167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5d38c5bf-830e-4ab9-a421-c0dc619a534d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.112678 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-31ad9d1f-5f0f-4ba3-9146-b0de714deb10 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:54.120760 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5d38c5bf-830e-4ab9-a421-c0dc619a534d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:54.121340 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-31ad9d1f-5f0f-4ba3-9146-b0de714deb10 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.229061 Aug 10 23:14:54.121937 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 107/208] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:53 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:54.128066 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5d38c5bf-830e-4ab9-a421-c0dc619a534d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.222774 Aug 10 23:14:54.128719 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 102/209] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:53 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:55.142212 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-59048bfe-c0b2-406c-b5c1-43ecd3724c44 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:55.144108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-59048bfe-c0b2-406c-b5c1-43ecd3724c44 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:55.146220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=62 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:55.151546 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-eccd3594-6ea1-4a21-96dc-a8db996e011d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:55.152479 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-eccd3594-6ea1-4a21-96dc-a8db996e011d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:55.157950 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59048bfe-c0b2-406c-b5c1-43ecd3724c44 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.157950 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59048bfe-c0b2-406c-b5c1-43ecd3724c44 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.157950 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59048bfe-c0b2-406c-b5c1-43ecd3724c44 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.157950 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59048bfe-c0b2-406c-b5c1-43ecd3724c44 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.158308 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59048bfe-c0b2-406c-b5c1-43ecd3724c44 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.158402 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:55.158496 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59048bfe-c0b2-406c-b5c1-43ecd3724c44 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.160566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eccd3594-6ea1-4a21-96dc-a8db996e011d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.161165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eccd3594-6ea1-4a21-96dc-a8db996e011d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.161601 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eccd3594-6ea1-4a21-96dc-a8db996e011d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.162294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eccd3594-6ea1-4a21-96dc-a8db996e011d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.162871 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eccd3594-6ea1-4a21-96dc-a8db996e011d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.163295 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eccd3594-6ea1-4a21-96dc-a8db996e011d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.390466 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-59048bfe-c0b2-406c-b5c1-43ecd3724c44 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:55.394596 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-eccd3594-6ea1-4a21-96dc-a8db996e011d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:55.398548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-59048bfe-c0b2-406c-b5c1-43ecd3724c44 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.260519 Aug 10 23:14:55.399150 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 108/210] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:55 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:55.402240 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-eccd3594-6ea1-4a21-96dc-a8db996e011d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.255278 Aug 10 23:14:55.402834 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 103/211] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:55 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:56.421931 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e9467547-4dcf-4e07-bcba-62368baf31d2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:56.422735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e9467547-4dcf-4e07-bcba-62368baf31d2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:56.425028 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1dacde2c-8cf4-4066-93c5-fb8582f67713 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:56.426125 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1dacde2c-8cf4-4066-93c5-fb8582f67713 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:56.430162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9467547-4dcf-4e07-bcba-62368baf31d2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.430646 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9467547-4dcf-4e07-bcba-62368baf31d2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.431107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9467547-4dcf-4e07-bcba-62368baf31d2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.431812 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9467547-4dcf-4e07-bcba-62368baf31d2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.432272 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9467547-4dcf-4e07-bcba-62368baf31d2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.432561 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1dacde2c-8cf4-4066-93c5-fb8582f67713 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.432754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9467547-4dcf-4e07-bcba-62368baf31d2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.433522 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1dacde2c-8cf4-4066-93c5-fb8582f67713 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.433522 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1dacde2c-8cf4-4066-93c5-fb8582f67713 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.434158 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1dacde2c-8cf4-4066-93c5-fb8582f67713 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.434608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1dacde2c-8cf4-4066-93c5-fb8582f67713 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.435229 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1dacde2c-8cf4-4066-93c5-fb8582f67713 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.632184 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e9467547-4dcf-4e07-bcba-62368baf31d2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:56.638931 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1dacde2c-8cf4-4066-93c5-fb8582f67713 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:56.640837 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e9467547-4dcf-4e07-bcba-62368baf31d2 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.222921 Aug 10 23:14:56.641420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 109/212] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:56 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:56.643514 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1dacde2c-8cf4-4066-93c5-fb8582f67713 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.222276 Aug 10 23:14:56.644078 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 104/213] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:56 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:57.661778 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ef1432a6-3cae-4305-89d7-a378ce3d28bd tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:57.662413 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ef1432a6-3cae-4305-89d7-a378ce3d28bd tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:57.664576 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d4d08308-bd03-4656-98f6-9e7904196f94 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:57.665936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d4d08308-bd03-4656-98f6-9e7904196f94 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:57.669526 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef1432a6-3cae-4305-89d7-a378ce3d28bd tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.670017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef1432a6-3cae-4305-89d7-a378ce3d28bd tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.670460 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef1432a6-3cae-4305-89d7-a378ce3d28bd tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.671228 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef1432a6-3cae-4305-89d7-a378ce3d28bd tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.671687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef1432a6-3cae-4305-89d7-a378ce3d28bd tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.672116 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef1432a6-3cae-4305-89d7-a378ce3d28bd tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.672769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d4d08308-bd03-4656-98f6-9e7904196f94 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.673326 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d4d08308-bd03-4656-98f6-9e7904196f94 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.673829 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d4d08308-bd03-4656-98f6-9e7904196f94 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.674593 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d4d08308-bd03-4656-98f6-9e7904196f94 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.675166 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d4d08308-bd03-4656-98f6-9e7904196f94 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.675701 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d4d08308-bd03-4656-98f6-9e7904196f94 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.871627 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ef1432a6-3cae-4305-89d7-a378ce3d28bd tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:57.875098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d4d08308-bd03-4656-98f6-9e7904196f94 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:57.882797 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d4d08308-bd03-4656-98f6-9e7904196f94 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.222375 Aug 10 23:14:57.883295 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 105/214] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:57 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:57.884836 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ef1432a6-3cae-4305-89d7-a378ce3d28bd tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.227475 Aug 10 23:14:57.885444 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 110/215] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:57 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:58.903828 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e18e7d52-03aa-43b4-9a1d-a2515bf68c83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:58.904400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f5bfb0f5-ca50-4c07-8e31-300a01d12b40 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:58.904759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e18e7d52-03aa-43b4-9a1d-a2515bf68c83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:58.904982 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f5bfb0f5-ca50-4c07-8e31-300a01d12b40 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:58.911557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e18e7d52-03aa-43b4-9a1d-a2515bf68c83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.911812 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5bfb0f5-ca50-4c07-8e31-300a01d12b40 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.912088 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e18e7d52-03aa-43b4-9a1d-a2515bf68c83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.912308 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5bfb0f5-ca50-4c07-8e31-300a01d12b40 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.912419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e18e7d52-03aa-43b4-9a1d-a2515bf68c83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.913067 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5bfb0f5-ca50-4c07-8e31-300a01d12b40 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.913174 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e18e7d52-03aa-43b4-9a1d-a2515bf68c83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.913543 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e18e7d52-03aa-43b4-9a1d-a2515bf68c83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.913830 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5bfb0f5-ca50-4c07-8e31-300a01d12b40 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.913962 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e18e7d52-03aa-43b4-9a1d-a2515bf68c83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.914282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5bfb0f5-ca50-4c07-8e31-300a01d12b40 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.915304 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5bfb0f5-ca50-4c07-8e31-300a01d12b40 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.105854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f5bfb0f5-ca50-4c07-8e31-300a01d12b40 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:59.110941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e18e7d52-03aa-43b4-9a1d-a2515bf68c83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:59.114257 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f5bfb0f5-ca50-4c07-8e31-300a01d12b40 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.213563 Aug 10 23:14:59.115461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 111/216] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:58 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:59.119544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e18e7d52-03aa-43b4-9a1d-a2515bf68c83 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.219815 Aug 10 23:14:59.120192 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 106/217] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:58 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:00.136703 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-895b72ce-cd25-4d80-a5cc-403bfcdd9213 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:00.137320 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-895b72ce-cd25-4d80-a5cc-403bfcdd9213 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:00.141441 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1da7fbc0-7221-4c93-88b1-448abccfdd63 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:00.142057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1da7fbc0-7221-4c93-88b1-448abccfdd63 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:00.143484 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-895b72ce-cd25-4d80-a5cc-403bfcdd9213 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.143972 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-895b72ce-cd25-4d80-a5cc-403bfcdd9213 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.144409 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-895b72ce-cd25-4d80-a5cc-403bfcdd9213 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.145109 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-895b72ce-cd25-4d80-a5cc-403bfcdd9213 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.145622 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-895b72ce-cd25-4d80-a5cc-403bfcdd9213 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.145996 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-895b72ce-cd25-4d80-a5cc-403bfcdd9213 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.148601 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1da7fbc0-7221-4c93-88b1-448abccfdd63 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.149164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1da7fbc0-7221-4c93-88b1-448abccfdd63 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.149513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1da7fbc0-7221-4c93-88b1-448abccfdd63 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.150212 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1da7fbc0-7221-4c93-88b1-448abccfdd63 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.150676 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1da7fbc0-7221-4c93-88b1-448abccfdd63 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.151116 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1da7fbc0-7221-4c93-88b1-448abccfdd63 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.361396 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-895b72ce-cd25-4d80-a5cc-403bfcdd9213 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:00.367247 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1da7fbc0-7221-4c93-88b1-448abccfdd63 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:00.371214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-895b72ce-cd25-4d80-a5cc-403bfcdd9213 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.239057 Aug 10 23:15:00.371798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 112/218] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:00 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:00.375998 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1da7fbc0-7221-4c93-88b1-448abccfdd63 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.238254 Aug 10 23:15:00.376572 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 107/219] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:00 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:01.391790 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-88b64979-56f6-4ede-ae41-470fcaa5cd3b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:01.392405 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-88b64979-56f6-4ede-ae41-470fcaa5cd3b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:01.396247 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-aa41beba-b60e-463c-a251-af4c8e26bf64 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:01.396871 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-aa41beba-b60e-463c-a251-af4c8e26bf64 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:01.398416 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88b64979-56f6-4ede-ae41-470fcaa5cd3b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.398960 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88b64979-56f6-4ede-ae41-470fcaa5cd3b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.399398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88b64979-56f6-4ede-ae41-470fcaa5cd3b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.400096 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88b64979-56f6-4ede-ae41-470fcaa5cd3b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.400550 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88b64979-56f6-4ede-ae41-470fcaa5cd3b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.400973 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-88b64979-56f6-4ede-ae41-470fcaa5cd3b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.403424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa41beba-b60e-463c-a251-af4c8e26bf64 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.403908 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa41beba-b60e-463c-a251-af4c8e26bf64 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.404373 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa41beba-b60e-463c-a251-af4c8e26bf64 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.405078 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa41beba-b60e-463c-a251-af4c8e26bf64 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.405534 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa41beba-b60e-463c-a251-af4c8e26bf64 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.405966 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa41beba-b60e-463c-a251-af4c8e26bf64 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.598347 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-88b64979-56f6-4ede-ae41-470fcaa5cd3b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:01.605196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-aa41beba-b60e-463c-a251-af4c8e26bf64 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:01.606596 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-88b64979-56f6-4ede-ae41-470fcaa5cd3b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.218602 Aug 10 23:15:01.607196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 113/220] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:01 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:01.612614 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-aa41beba-b60e-463c-a251-af4c8e26bf64 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.220182 Aug 10 23:15:01.613248 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 108/221] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:01 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:02.628616 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ab495f3b-5e5b-4158-a43c-c37789d80e2e tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:02.629246 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ab495f3b-5e5b-4158-a43c-c37789d80e2e tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:02.634967 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ad94d4a1-f159-4872-9c81-fd379af1304f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:02.635471 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ad94d4a1-f159-4872-9c81-fd379af1304f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:02.636044 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ab495f3b-5e5b-4158-a43c-c37789d80e2e tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:02.636536 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ab495f3b-5e5b-4158-a43c-c37789d80e2e tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:02.636985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ab495f3b-5e5b-4158-a43c-c37789d80e2e tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.637682 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ab495f3b-5e5b-4158-a43c-c37789d80e2e tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:02.638141 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ab495f3b-5e5b-4158-a43c-c37789d80e2e tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:02.638569 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ab495f3b-5e5b-4158-a43c-c37789d80e2e tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.641954 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad94d4a1-f159-4872-9c81-fd379af1304f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:02.642435 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad94d4a1-f159-4872-9c81-fd379af1304f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:02.643071 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad94d4a1-f159-4872-9c81-fd379af1304f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.643800 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad94d4a1-f159-4872-9c81-fd379af1304f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:02.644401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad94d4a1-f159-4872-9c81-fd379af1304f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:02.644826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad94d4a1-f159-4872-9c81-fd379af1304f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.853765 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ad94d4a1-f159-4872-9c81-fd379af1304f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:02.857151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:02.860673 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ab495f3b-5e5b-4158-a43c-c37789d80e2e tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:02.861565 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ad94d4a1-f159-4872-9c81-fd379af1304f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.231321 Aug 10 23:15:02.862141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 109/222] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:02 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:02.869493 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ab495f3b-5e5b-4158-a43c-c37789d80e2e tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1554 microversion: 2.1 time: 0.245679 Aug 10 23:15:02.870306 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 114/223] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:02 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:03.794454 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-b9651c92-ec54-44cd-b0c9-54c91475f84a req-14f3109c-27ed-4178-95e5-cff7fca14414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae8526a-d85b-4176-a4b8-938d4617b7a3", "name": "network-vif-deleted", "tag": "e427d004-9e4c-4ac6-a10d-f49430b10c39"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:03.818332 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-b9651c92-ec54-44cd-b0c9-54c91475f84a req-14f3109c-27ed-4178-95e5-cff7fca14414 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.819431 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-b9651c92-ec54-44cd-b0c9-54c91475f84a req-14f3109c-27ed-4178-95e5-cff7fca14414 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.819744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-b9651c92-ec54-44cd-b0c9-54c91475f84a req-14f3109c-27ed-4178-95e5-cff7fca14414 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.834303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-b9651c92-ec54-44cd-b0c9-54c91475f84a req-14f3109c-27ed-4178-95e5-cff7fca14414 service nova] Creating event network-vif-deleted:e427d004-9e4c-4ac6-a10d-f49430b10c39 for instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 on hv-cinder-85144 Aug 10 23:15:03.840245 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-b9651c92-ec54-44cd-b0c9-54c91475f84a req-14f3109c-27ed-4178-95e5-cff7fca14414 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058923 Aug 10 23:15:03.841481 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 110/224] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:03.883147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-47ffa487-af3b-4168-87ba-358c65c6b919 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:03.884374 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-47ffa487-af3b-4168-87ba-358c65c6b919 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:03.894248 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d3507749-6bc8-4d2d-83f2-588b7a09d4fb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:03.894498 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-47ffa487-af3b-4168-87ba-358c65c6b919 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.895382 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d3507749-6bc8-4d2d-83f2-588b7a09d4fb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:03.895776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-47ffa487-af3b-4168-87ba-358c65c6b919 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.896419 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-47ffa487-af3b-4168-87ba-358c65c6b919 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.897263 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-47ffa487-af3b-4168-87ba-358c65c6b919 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.897914 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-47ffa487-af3b-4168-87ba-358c65c6b919 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.898436 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-47ffa487-af3b-4168-87ba-358c65c6b919 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.903254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3507749-6bc8-4d2d-83f2-588b7a09d4fb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.903679 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3507749-6bc8-4d2d-83f2-588b7a09d4fb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.904112 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3507749-6bc8-4d2d-83f2-588b7a09d4fb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.904820 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3507749-6bc8-4d2d-83f2-588b7a09d4fb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.905279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3507749-6bc8-4d2d-83f2-588b7a09d4fb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.905705 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3507749-6bc8-4d2d-83f2-588b7a09d4fb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.924345 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=100 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:04.020176 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d3507749-6bc8-4d2d-83f2-588b7a09d4fb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:04.033832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d3507749-6bc8-4d2d-83f2-588b7a09d4fb tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1512 microversion: 2.1 time: 0.144057 Aug 10 23:15:04.054077 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 111/225] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:03 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:04.099574 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-47ffa487-af3b-4168-87ba-358c65c6b919 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:04.107745 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-47ffa487-af3b-4168-87ba-358c65c6b919 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.228550 Aug 10 23:15:04.108310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 115/226] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:03 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:05.062405 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:05.063836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:05.071017 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:05.071507 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:05.071932 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:05.072826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:05.073440 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:05.074042 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:05.106678 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:05.107166 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:05.107601 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:05.108070 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lazy-loading 'fault' on Instance uuid 7ae8526a-d85b-4176-a4b8-938d4617b7a3 {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:15:05.129573 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-90c0b77a-f13f-4c58-9555-c032a17e71dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:05.130351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-90c0b77a-f13f-4c58-9555-c032a17e71dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:05.136807 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-90c0b77a-f13f-4c58-9555-c032a17e71dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:05.137365 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-90c0b77a-f13f-4c58-9555-c032a17e71dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:05.137893 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-90c0b77a-f13f-4c58-9555-c032a17e71dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:05.138773 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-90c0b77a-f13f-4c58-9555-c032a17e71dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:05.139296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-90c0b77a-f13f-4c58-9555-c032a17e71dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:05.139791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-90c0b77a-f13f-4c58-9555-c032a17e71dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:05.152372 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2e6ec64db4ba3b3db2ca564c26bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0df50573341beb4cf1e2480ba6736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:05.160502 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2d2fb9a1-8739-43eb-bb87-81ffb0272456 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 200 len: 1351 microversion: 2.1 time: 0.104694 Aug 10 23:15:05.161067 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 112/227] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:05 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:05.341379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-90c0b77a-f13f-4c58-9555-c032a17e71dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:05.355413 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-90c0b77a-f13f-4c58-9555-c032a17e71dc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.229353 Aug 10 23:15:05.356712 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 116/228] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:05 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:06.183962 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:06.184699 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:06.192412 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:06.194497 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:06.195086 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:06.206396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:06.206396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:06.206396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:06.212103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] HTTP exception thrown: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Request method failure captured: Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 HTTP/1.1 Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DugKfzX6BDd-i3JQXBtcifQeIWqYv4jGS-PcEXvygYR1cIixF2UGqwTsavq0abQWIaLiu3ZojtuhyQKfkIyj7j8zL4i29NfSRNtt3rbz6ezNDKcr2S0LAXKWtxaUw3EvwzorvCsoIP8dmvu0rw55Ssl0brFXqmBJLkaY4io2ZuKB4Q Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 78a0df50573341beb4cf1e2480ba6736 Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:15:06.216953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_78a0df50573341beb4cf1e2480ba6736", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 78a0df50573341beb4cf1e2480ba6736 Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-DeleteServersTestJSON-1053295736-project Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: c5f2e6ec64db4ba3b3db2ca564c26bed Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-DeleteServersTestJSON-1053295736-project Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:06.218280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': '7ae8526a-d85b-4176-a4b8-938d4617b7a3'} Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:06.219892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:06.221646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:15:06.222811 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Returning 404 to user: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:06.222811 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-27fcda4c-e0db-4810-b53c-2220c60b86a8 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 404 len: 111 microversion: 2.1 time: 0.038346 Aug 10 23:15:06.222811 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 113/229] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:06 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:06.342975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:06.346210 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:06.352889 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:06.353372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:06.353801 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:06.354493 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:06.355011 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:06.355602 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:06.372587 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] HTTP exception thrown: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Request method failure captured: Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3/os-volume_attachments HTTP/1.1 Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DugKfzX6BDd-i3JQXBtcifQeIWqYv4jGS-PcEXvygYR1cIixF2UGqwTsavq0abQWIaLiu3ZojtuhyQKfkIyj7j8zL4i29NfSRNtt3rbz6ezNDKcr2S0LAXKWtxaUw3EvwzorvCsoIP8dmvu0rw55Ssl0brFXqmBJLkaY4io2ZuKB4Q Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 78a0df50573341beb4cf1e2480ba6736 Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:15:06.374715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_78a0df50573341beb4cf1e2480ba6736", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 78a0df50573341beb4cf1e2480ba6736 Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-DeleteServersTestJSON-1053295736-project Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: c5f2e6ec64db4ba3b3db2ca564c26bed Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-DeleteServersTestJSON-1053295736-project Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:06.376252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'server_id': '7ae8526a-d85b-4176-a4b8-938d4617b7a3'} Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:06.377098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:06.378438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:06.380478 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Returning 404 to user: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:06.380478 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e7779872-f7e4-4a4d-8f3d-819476d70641 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037294 Aug 10 23:15:06.380478 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 117/230] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:15:06 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:06.384868 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2b3f8e1c-a1fd-46f0-b607-59646b87da26 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:06.386166 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2b3f8e1c-a1fd-46f0-b607-59646b87da26 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:06.392639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2b3f8e1c-a1fd-46f0-b607-59646b87da26 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:06.393135 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2b3f8e1c-a1fd-46f0-b607-59646b87da26 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:06.393733 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2b3f8e1c-a1fd-46f0-b607-59646b87da26 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:06.394936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2b3f8e1c-a1fd-46f0-b607-59646b87da26 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:06.395401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2b3f8e1c-a1fd-46f0-b607-59646b87da26 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:06.395836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2b3f8e1c-a1fd-46f0-b607-59646b87da26 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:06.540612 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2b3f8e1c-a1fd-46f0-b607-59646b87da26 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:06.548057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2b3f8e1c-a1fd-46f0-b607-59646b87da26 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.174145 Aug 10 23:15:06.548613 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 114/231] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:06 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:07.570218 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-731248af-a7e3-48aa-8e20-d86987fd8681 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:07.580319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-731248af-a7e3-48aa-8e20-d86987fd8681 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:07.580319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-731248af-a7e3-48aa-8e20-d86987fd8681 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.580319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-731248af-a7e3-48aa-8e20-d86987fd8681 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.580319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-731248af-a7e3-48aa-8e20-d86987fd8681 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.580840 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-731248af-a7e3-48aa-8e20-d86987fd8681 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.581163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-731248af-a7e3-48aa-8e20-d86987fd8681 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.581550 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-731248af-a7e3-48aa-8e20-d86987fd8681 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.755095 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-731248af-a7e3-48aa-8e20-d86987fd8681 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:07.772657 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-731248af-a7e3-48aa-8e20-d86987fd8681 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.206522 Aug 10 23:15:07.774007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 118/232] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:07 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:08.805903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-736ac6db-0bda-4dac-a8b5-d5fea120d557 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:08.806602 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-736ac6db-0bda-4dac-a8b5-d5fea120d557 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:08.814255 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-736ac6db-0bda-4dac-a8b5-d5fea120d557 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:08.814255 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-736ac6db-0bda-4dac-a8b5-d5fea120d557 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:08.814556 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-736ac6db-0bda-4dac-a8b5-d5fea120d557 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:08.815296 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-736ac6db-0bda-4dac-a8b5-d5fea120d557 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:08.815758 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-736ac6db-0bda-4dac-a8b5-d5fea120d557 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:08.816186 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-736ac6db-0bda-4dac-a8b5-d5fea120d557 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:08.834590 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:08.835226 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:08.841332 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:08.841620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:08.842055 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:08.842765 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:08.843332 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:08.843984 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:08.859454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] HTTP exception thrown: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Request method failure captured: Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: DELETE /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 HTTP/1.1 Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DugKfzX6BDd-i3JQXBtcifQeIWqYv4jGS-PcEXvygYR1cIixF2UGqwTsavq0abQWIaLiu3ZojtuhyQKfkIyj7j8zL4i29NfSRNtt3rbz6ezNDKcr2S0LAXKWtxaUw3EvwzorvCsoIP8dmvu0rw55Ssl0brFXqmBJLkaY4io2ZuKB4Q Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 78a0df50573341beb4cf1e2480ba6736 Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:15:08.861674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_78a0df50573341beb4cf1e2480ba6736", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 78a0df50573341beb4cf1e2480ba6736 Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-DeleteServersTestJSON-1053295736-project Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: c5f2e6ec64db4ba3b3db2ca564c26bed Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-DeleteServersTestJSON-1053295736-project Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:08.862944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '7ae8526a-d85b-4176-a4b8-938d4617b7a3'} Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:08.863663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:08.864951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:08.866065 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Returning 404 to user: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:08.866065 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dc5ea63d-44a8-4637-8ce4-9b566f91e01b tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 404 len: 111 microversion: 2.1 time: 0.032667 Aug 10 23:15:08.866065 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 119/233] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:15:08 2022] DELETE /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:15:08.872546 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:08.873240 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] [instance: 7ae8526a-d85b-4176-a4b8-938d4617b7a3] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:08.880084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:08.886019 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:08.886019 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:08.886019 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:08.886019 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:08.886437 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:08.909838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] HTTP exception thrown: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Request method failure captured: Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 HTTP/1.1 Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DugKfzX6BDd-i3JQXBtcifQeIWqYv4jGS-PcEXvygYR1cIixF2UGqwTsavq0abQWIaLiu3ZojtuhyQKfkIyj7j8zL4i29NfSRNtt3rbz6ezNDKcr2S0LAXKWtxaUw3EvwzorvCsoIP8dmvu0rw55Ssl0brFXqmBJLkaY4io2ZuKB4Q Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 78a0df50573341beb4cf1e2480ba6736 Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:15:08.911628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/78a0df50573341beb4cf1e2480ba6736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_78a0df50573341beb4cf1e2480ba6736", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 78a0df50573341beb4cf1e2480ba6736 Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-DeleteServersTestJSON-1053295736 Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-DeleteServersTestJSON-1053295736-project Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: c5f2e6ec64db4ba3b3db2ca564c26bed Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-DeleteServersTestJSON-1053295736-project Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:08.912742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '7ae8526a-d85b-4176-a4b8-938d4617b7a3'} Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:08.913395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. Aug 10 23:15:08.915571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:15:08.916884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] Returning 404 to user: Instance 7ae8526a-d85b-4176-a4b8-938d4617b7a3 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:08.916884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0c315612-4025-4483-879f-191e35db4210 tempest-DeleteServersTestJSON-1053295736 tempest-DeleteServersTestJSON-1053295736-project] 10.222.0.78 "GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3" status: 404 len: 111 microversion: 2.1 time: 0.044888 Aug 10 23:15:08.916884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 120/234] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:08 2022] GET /compute/v2.1/servers/7ae8526a-d85b-4176-a4b8-938d4617b7a3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:15:09.042254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-736ac6db-0bda-4dac-a8b5-d5fea120d557 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:09.048282 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-736ac6db-0bda-4dac-a8b5-d5fea120d557 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.246708 Aug 10 23:15:09.049254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 115/235] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:08 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:10.072735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e4fef481-6e16-43eb-bde4-3508a0dddcd7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:10.074035 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e4fef481-6e16-43eb-bde4-3508a0dddcd7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:10.080181 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fef481-6e16-43eb-bde4-3508a0dddcd7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:10.080846 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fef481-6e16-43eb-bde4-3508a0dddcd7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:10.081334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fef481-6e16-43eb-bde4-3508a0dddcd7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:10.082047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fef481-6e16-43eb-bde4-3508a0dddcd7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:10.082770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fef481-6e16-43eb-bde4-3508a0dddcd7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:10.083206 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fef481-6e16-43eb-bde4-3508a0dddcd7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:10.437300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e4fef481-6e16-43eb-bde4-3508a0dddcd7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:10.453622 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e4fef481-6e16-43eb-bde4-3508a0dddcd7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.387784 Aug 10 23:15:10.457151 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 121/236] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:10 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:11.480699 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5ec956f6-33d7-4890-8ecc-e6fb436afdaa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:11.486534 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5ec956f6-33d7-4890-8ecc-e6fb436afdaa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:11.503000 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5ec956f6-33d7-4890-8ecc-e6fb436afdaa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.503792 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5ec956f6-33d7-4890-8ecc-e6fb436afdaa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.503917 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5ec956f6-33d7-4890-8ecc-e6fb436afdaa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.504639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5ec956f6-33d7-4890-8ecc-e6fb436afdaa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.505094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5ec956f6-33d7-4890-8ecc-e6fb436afdaa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.505701 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5ec956f6-33d7-4890-8ecc-e6fb436afdaa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.841057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5ec956f6-33d7-4890-8ecc-e6fb436afdaa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:11.849446 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5ec956f6-33d7-4890-8ecc-e6fb436afdaa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1521 microversion: 2.1 time: 0.376291 Aug 10 23:15:11.850182 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 116/237] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:11 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:12.870644 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-09782206-db67-4886-a7be-54fe0bab8646 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:12.871287 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-09782206-db67-4886-a7be-54fe0bab8646 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:12.882982 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-09782206-db67-4886-a7be-54fe0bab8646 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:12.890124 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-09782206-db67-4886-a7be-54fe0bab8646 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:12.890831 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-09782206-db67-4886-a7be-54fe0bab8646 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:12.891732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-09782206-db67-4886-a7be-54fe0bab8646 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:12.892504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-09782206-db67-4886-a7be-54fe0bab8646 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:12.893341 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-09782206-db67-4886-a7be-54fe0bab8646 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.035998 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-09782206-db67-4886-a7be-54fe0bab8646 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:13.045200 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-09782206-db67-4886-a7be-54fe0bab8646 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1501 microversion: 2.1 time: 0.179592 Aug 10 23:15:13.046024 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 122/238] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:12 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:13.072907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7eb16cbc-02a0-4e64-a2ad-e6f50775a6bc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:13.073394 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7eb16cbc-02a0-4e64-a2ad-e6f50775a6bc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:13.080427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb16cbc-02a0-4e64-a2ad-e6f50775a6bc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:13.081165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb16cbc-02a0-4e64-a2ad-e6f50775a6bc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:13.083094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb16cbc-02a0-4e64-a2ad-e6f50775a6bc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.084371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb16cbc-02a0-4e64-a2ad-e6f50775a6bc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:13.087104 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb16cbc-02a0-4e64-a2ad-e6f50775a6bc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:13.087769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb16cbc-02a0-4e64-a2ad-e6f50775a6bc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.343778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7eb16cbc-02a0-4e64-a2ad-e6f50775a6bc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:13.359636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7eb16cbc-02a0-4e64-a2ad-e6f50775a6bc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1516 microversion: 2.1 time: 0.292311 Aug 10 23:15:13.360459 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 117/239] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:13 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1516 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:21.378539 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e68c177c-edb5-4bf7-9b77-54684c3e983b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:21.380994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e68c177c-edb5-4bf7-9b77-54684c3e983b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:21.387807 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e68c177c-edb5-4bf7-9b77-54684c3e983b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:21.388297 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e68c177c-edb5-4bf7-9b77-54684c3e983b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:21.388736 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e68c177c-edb5-4bf7-9b77-54684c3e983b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:21.389561 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e68c177c-edb5-4bf7-9b77-54684c3e983b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:21.390100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e68c177c-edb5-4bf7-9b77-54684c3e983b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:21.390763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e68c177c-edb5-4bf7-9b77-54684c3e983b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:21.419987 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-e68c177c-edb5-4bf7-9b77-54684c3e983b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lazy-loading 'flavor' on Instance uuid 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:15:21.864809 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e68c177c-edb5-4bf7-9b77-54684c3e983b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66/action" status: 200 len: 32 microversion: 2.1 time: 0.490149 Aug 10 23:15:21.867812 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 123/240] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:21 2022] POST /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66/action => generated 32 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:15:21.875960 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e83a26a0-cbbd-4f5b-9384-db2b4c6561e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:21.877116 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e83a26a0-cbbd-4f5b-9384-db2b4c6561e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:21.886359 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e83a26a0-cbbd-4f5b-9384-db2b4c6561e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:21.886875 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e83a26a0-cbbd-4f5b-9384-db2b4c6561e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:21.887310 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e83a26a0-cbbd-4f5b-9384-db2b4c6561e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:21.888010 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e83a26a0-cbbd-4f5b-9384-db2b4c6561e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:21.888518 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e83a26a0-cbbd-4f5b-9384-db2b4c6561e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:21.888938 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e83a26a0-cbbd-4f5b-9384-db2b4c6561e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:22.063714 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e83a26a0-cbbd-4f5b-9384-db2b4c6561e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:22.071241 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e83a26a0-cbbd-4f5b-9384-db2b4c6561e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.199587 Aug 10 23:15:22.071808 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 118/241] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:21 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:23.093310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-19d6cb90-b1f4-4910-b535-28d00649f41c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:23.093939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-19d6cb90-b1f4-4910-b535-28d00649f41c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:23.101044 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19d6cb90-b1f4-4910-b535-28d00649f41c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.102171 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19d6cb90-b1f4-4910-b535-28d00649f41c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.102622 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19d6cb90-b1f4-4910-b535-28d00649f41c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.103474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19d6cb90-b1f4-4910-b535-28d00649f41c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.103939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19d6cb90-b1f4-4910-b535-28d00649f41c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.104370 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-19d6cb90-b1f4-4910-b535-28d00649f41c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.249259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-19d6cb90-b1f4-4910-b535-28d00649f41c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:23.257126 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-19d6cb90-b1f4-4910-b535-28d00649f41c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.168105 Aug 10 23:15:23.257700 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 124/242] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:23 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:24.277776 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-07537603-acca-47a3-902d-ae60780875cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:24.279219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-07537603-acca-47a3-902d-ae60780875cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:24.285949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07537603-acca-47a3-902d-ae60780875cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:24.287015 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07537603-acca-47a3-902d-ae60780875cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:24.296630 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07537603-acca-47a3-902d-ae60780875cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:24.299285 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07537603-acca-47a3-902d-ae60780875cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:24.299285 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07537603-acca-47a3-902d-ae60780875cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:24.299285 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07537603-acca-47a3-902d-ae60780875cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:24.574685 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-07537603-acca-47a3-902d-ae60780875cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:24.582231 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-07537603-acca-47a3-902d-ae60780875cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.308673 Aug 10 23:15:24.582883 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 119/243] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:24 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:25.603174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4e05b532-8b14-4325-a39a-a3c2e46d70d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:25.603977 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4e05b532-8b14-4325-a39a-a3c2e46d70d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:25.606053 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=34 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:25.610845 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e05b532-8b14-4325-a39a-a3c2e46d70d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.611335 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e05b532-8b14-4325-a39a-a3c2e46d70d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.611768 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e05b532-8b14-4325-a39a-a3c2e46d70d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.612466 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e05b532-8b14-4325-a39a-a3c2e46d70d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.612921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e05b532-8b14-4325-a39a-a3c2e46d70d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.613346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4e05b532-8b14-4325-a39a-a3c2e46d70d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.800126 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4e05b532-8b14-4325-a39a-a3c2e46d70d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:25.808753 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4e05b532-8b14-4325-a39a-a3c2e46d70d7 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.209412 Aug 10 23:15:25.810008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 125/244] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:25 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:26.829534 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cb0fe83c-a4c1-49b9-866d-f8f29bbaf4fd tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:26.830131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cb0fe83c-a4c1-49b9-866d-f8f29bbaf4fd tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:26.832595 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=36 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:26.838021 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb0fe83c-a4c1-49b9-866d-f8f29bbaf4fd tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:26.838495 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb0fe83c-a4c1-49b9-866d-f8f29bbaf4fd tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:26.838948 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb0fe83c-a4c1-49b9-866d-f8f29bbaf4fd tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:26.839661 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb0fe83c-a4c1-49b9-866d-f8f29bbaf4fd tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:26.840111 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb0fe83c-a4c1-49b9-866d-f8f29bbaf4fd tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:26.840529 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb0fe83c-a4c1-49b9-866d-f8f29bbaf4fd tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:26.977850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cb0fe83c-a4c1-49b9-866d-f8f29bbaf4fd tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:26.985218 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cb0fe83c-a4c1-49b9-866d-f8f29bbaf4fd tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.159721 Aug 10 23:15:26.985771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 120/245] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:26 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:28.020798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9b5a9b27-2d0d-4007-a53e-87e09484d35f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:28.021345 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9b5a9b27-2d0d-4007-a53e-87e09484d35f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:28.027890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b5a9b27-2d0d-4007-a53e-87e09484d35f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:28.029890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b5a9b27-2d0d-4007-a53e-87e09484d35f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:28.029890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b5a9b27-2d0d-4007-a53e-87e09484d35f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:28.029890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b5a9b27-2d0d-4007-a53e-87e09484d35f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:28.029890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b5a9b27-2d0d-4007-a53e-87e09484d35f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:28.030306 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b5a9b27-2d0d-4007-a53e-87e09484d35f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:28.179932 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9b5a9b27-2d0d-4007-a53e-87e09484d35f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:28.187689 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9b5a9b27-2d0d-4007-a53e-87e09484d35f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.171446 Aug 10 23:15:28.188347 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 126/246] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:28 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:29.209763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fb922d3b-fa0c-4f6f-8fa2-0c25a2b69a3a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:29.212540 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-fb922d3b-fa0c-4f6f-8fa2-0c25a2b69a3a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:29.232856 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb922d3b-fa0c-4f6f-8fa2-0c25a2b69a3a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:29.232856 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb922d3b-fa0c-4f6f-8fa2-0c25a2b69a3a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:29.232856 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb922d3b-fa0c-4f6f-8fa2-0c25a2b69a3a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:29.232856 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb922d3b-fa0c-4f6f-8fa2-0c25a2b69a3a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:29.233275 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb922d3b-fa0c-4f6f-8fa2-0c25a2b69a3a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:29.233275 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb922d3b-fa0c-4f6f-8fa2-0c25a2b69a3a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:29.363120 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-fb922d3b-fa0c-4f6f-8fa2-0c25a2b69a3a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:29.370402 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-fb922d3b-fa0c-4f6f-8fa2-0c25a2b69a3a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.165032 Aug 10 23:15:29.376354 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 121/247] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:29 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:30.395434 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3ab7109f-177c-46e3-b9eb-53129d0688d9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:30.396277 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3ab7109f-177c-46e3-b9eb-53129d0688d9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:30.402400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ab7109f-177c-46e3-b9eb-53129d0688d9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:30.402933 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ab7109f-177c-46e3-b9eb-53129d0688d9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:30.403372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ab7109f-177c-46e3-b9eb-53129d0688d9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:30.404067 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ab7109f-177c-46e3-b9eb-53129d0688d9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:30.404523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ab7109f-177c-46e3-b9eb-53129d0688d9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:30.404945 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ab7109f-177c-46e3-b9eb-53129d0688d9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:30.562473 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3ab7109f-177c-46e3-b9eb-53129d0688d9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:30.572620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3ab7109f-177c-46e3-b9eb-53129d0688d9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.181301 Aug 10 23:15:30.573205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 127/248] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:30 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:31.593683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b01bba0f-b43e-4c10-8fe5-edd3b3c83e1a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:31.594509 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b01bba0f-b43e-4c10-8fe5-edd3b3c83e1a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:31.601484 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b01bba0f-b43e-4c10-8fe5-edd3b3c83e1a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:31.601926 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b01bba0f-b43e-4c10-8fe5-edd3b3c83e1a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:31.602358 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b01bba0f-b43e-4c10-8fe5-edd3b3c83e1a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:31.603079 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b01bba0f-b43e-4c10-8fe5-edd3b3c83e1a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:31.603528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b01bba0f-b43e-4c10-8fe5-edd3b3c83e1a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:31.603949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b01bba0f-b43e-4c10-8fe5-edd3b3c83e1a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:31.773223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b01bba0f-b43e-4c10-8fe5-edd3b3c83e1a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:31.783420 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b01bba0f-b43e-4c10-8fe5-edd3b3c83e1a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.192923 Aug 10 23:15:31.787872 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 122/249] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:31 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:32.811614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d29434d3-0063-4cdd-be28-711c8edebcc1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:32.811614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d29434d3-0063-4cdd-be28-711c8edebcc1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:32.814366 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d29434d3-0063-4cdd-be28-711c8edebcc1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:32.814902 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d29434d3-0063-4cdd-be28-711c8edebcc1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:32.815348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d29434d3-0063-4cdd-be28-711c8edebcc1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:32.816062 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d29434d3-0063-4cdd-be28-711c8edebcc1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:32.816519 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d29434d3-0063-4cdd-be28-711c8edebcc1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:32.816944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d29434d3-0063-4cdd-be28-711c8edebcc1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:32.970236 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d29434d3-0063-4cdd-be28-711c8edebcc1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:32.973084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d29434d3-0063-4cdd-be28-711c8edebcc1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.170924 Aug 10 23:15:32.973655 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 128/250] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:32 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:33.993510 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-afa7abb9-a052-4291-a228-821d605cf6a3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:33.994214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-afa7abb9-a052-4291-a228-821d605cf6a3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:34.001448 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-afa7abb9-a052-4291-a228-821d605cf6a3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:34.002134 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-afa7abb9-a052-4291-a228-821d605cf6a3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:34.002826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-afa7abb9-a052-4291-a228-821d605cf6a3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:34.003592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-afa7abb9-a052-4291-a228-821d605cf6a3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:34.004245 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-afa7abb9-a052-4291-a228-821d605cf6a3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:34.004754 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-afa7abb9-a052-4291-a228-821d605cf6a3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:34.139811 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-afa7abb9-a052-4291-a228-821d605cf6a3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:34.147271 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-afa7abb9-a052-4291-a228-821d605cf6a3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.157895 Aug 10 23:15:34.147829 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 123/251] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:33 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:35.169928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3c303cae-0389-4ed8-b6fc-d95a350e0bb3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:35.172697 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3c303cae-0389-4ed8-b6fc-d95a350e0bb3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:35.180026 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3c303cae-0389-4ed8-b6fc-d95a350e0bb3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.180754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3c303cae-0389-4ed8-b6fc-d95a350e0bb3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.181361 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3c303cae-0389-4ed8-b6fc-d95a350e0bb3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.182237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3c303cae-0389-4ed8-b6fc-d95a350e0bb3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.182782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3c303cae-0389-4ed8-b6fc-d95a350e0bb3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.183213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3c303cae-0389-4ed8-b6fc-d95a350e0bb3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.187155 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:35.312339 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3c303cae-0389-4ed8-b6fc-d95a350e0bb3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:35.319806 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3c303cae-0389-4ed8-b6fc-d95a350e0bb3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.155587 Aug 10 23:15:35.320361 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 129/252] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:35 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:36.341060 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3124b77a-54da-416e-86ed-5afb9849f7f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:36.341680 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3124b77a-54da-416e-86ed-5afb9849f7f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:36.348486 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3124b77a-54da-416e-86ed-5afb9849f7f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:36.348972 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3124b77a-54da-416e-86ed-5afb9849f7f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:36.349412 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3124b77a-54da-416e-86ed-5afb9849f7f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:36.350113 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3124b77a-54da-416e-86ed-5afb9849f7f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:36.350572 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3124b77a-54da-416e-86ed-5afb9849f7f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:36.351096 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3124b77a-54da-416e-86ed-5afb9849f7f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:36.353681 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=79 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:36.493169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3124b77a-54da-416e-86ed-5afb9849f7f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:36.501143 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3124b77a-54da-416e-86ed-5afb9849f7f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.164454 Aug 10 23:15:36.502047 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 124/253] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:36 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:37.526467 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-40c92ac0-4cd8-4455-aeaa-6de3907dbacc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:37.527241 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-40c92ac0-4cd8-4455-aeaa-6de3907dbacc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:37.534359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-40c92ac0-4cd8-4455-aeaa-6de3907dbacc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:37.534880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-40c92ac0-4cd8-4455-aeaa-6de3907dbacc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:37.535390 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-40c92ac0-4cd8-4455-aeaa-6de3907dbacc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:37.536157 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-40c92ac0-4cd8-4455-aeaa-6de3907dbacc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:37.539104 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-40c92ac0-4cd8-4455-aeaa-6de3907dbacc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:37.539104 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-40c92ac0-4cd8-4455-aeaa-6de3907dbacc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:37.685560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-40c92ac0-4cd8-4455-aeaa-6de3907dbacc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:37.694187 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-40c92ac0-4cd8-4455-aeaa-6de3907dbacc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.174149 Aug 10 23:15:37.703488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 130/254] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:37 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:38.716579 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c3a25f04-eea1-4311-a09a-e9292f7f8fdb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:38.717184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c3a25f04-eea1-4311-a09a-e9292f7f8fdb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:38.723842 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a25f04-eea1-4311-a09a-e9292f7f8fdb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:38.724322 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a25f04-eea1-4311-a09a-e9292f7f8fdb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:38.724751 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a25f04-eea1-4311-a09a-e9292f7f8fdb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:38.725440 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a25f04-eea1-4311-a09a-e9292f7f8fdb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:38.725892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a25f04-eea1-4311-a09a-e9292f7f8fdb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:38.726315 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a25f04-eea1-4311-a09a-e9292f7f8fdb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:38.858814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c3a25f04-eea1-4311-a09a-e9292f7f8fdb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:38.866332 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c3a25f04-eea1-4311-a09a-e9292f7f8fdb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.154327 Aug 10 23:15:38.866920 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 125/255] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:38 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:39.887884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b8db3253-bb50-4455-afce-8147c4843b6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:39.888562 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b8db3253-bb50-4455-afce-8147c4843b6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:39.894478 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8db3253-bb50-4455-afce-8147c4843b6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:39.895001 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8db3253-bb50-4455-afce-8147c4843b6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:39.895445 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8db3253-bb50-4455-afce-8147c4843b6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:39.896136 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8db3253-bb50-4455-afce-8147c4843b6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:39.896594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8db3253-bb50-4455-afce-8147c4843b6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:39.897026 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8db3253-bb50-4455-afce-8147c4843b6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:40.034560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b8db3253-bb50-4455-afce-8147c4843b6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:40.042063 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b8db3253-bb50-4455-afce-8147c4843b6c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.158010 Aug 10 23:15:40.042639 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 131/256] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:39 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:41.062832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2d2d7867-a445-45e2-9c11-e76a0cd2bae8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:41.063511 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2d2d7867-a445-45e2-9c11-e76a0cd2bae8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:41.069929 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2d7867-a445-45e2-9c11-e76a0cd2bae8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:41.070415 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2d7867-a445-45e2-9c11-e76a0cd2bae8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:41.070916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2d7867-a445-45e2-9c11-e76a0cd2bae8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:41.071635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2d7867-a445-45e2-9c11-e76a0cd2bae8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:41.072091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2d7867-a445-45e2-9c11-e76a0cd2bae8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:41.072520 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d2d7867-a445-45e2-9c11-e76a0cd2bae8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:41.212052 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2d2d7867-a445-45e2-9c11-e76a0cd2bae8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:41.237697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2d2d7867-a445-45e2-9c11-e76a0cd2bae8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.169986 Aug 10 23:15:41.250022 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 126/257] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:41 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:42.281028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f5cebc99-9474-4eb0-a77c-713391a1f368 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:42.281656 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f5cebc99-9474-4eb0-a77c-713391a1f368 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:42.287914 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5cebc99-9474-4eb0-a77c-713391a1f368 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.288406 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5cebc99-9474-4eb0-a77c-713391a1f368 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.288845 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5cebc99-9474-4eb0-a77c-713391a1f368 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.289579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5cebc99-9474-4eb0-a77c-713391a1f368 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.290034 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5cebc99-9474-4eb0-a77c-713391a1f368 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.290488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5cebc99-9474-4eb0-a77c-713391a1f368 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.423330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f5cebc99-9474-4eb0-a77c-713391a1f368 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:42.431207 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f5cebc99-9474-4eb0-a77c-713391a1f368 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1502 microversion: 2.1 time: 0.153919 Aug 10 23:15:42.431983 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 132/258] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:42 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:42.457137 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80884576-4f3c-47da-9cfd-cccf9ea0fb88"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:42.459684 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:42.473313 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.473812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.474249 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.474995 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.475449 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.480850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.501820 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] HTTP exception thrown: Cannot 'attach_volume' instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 while it is in vm_state rescued Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Request method failure captured: Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: POST /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66/os-volume_attachments HTTP/1.1 Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 74 Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DuabME7ZGHzYuz08OVq0R6TMPx--LgzVwK_UREHcD3-PQE3MaV4jBWp2AYr2OKi7kcY9Vep3prjScfU6CpAWsU3OQNYBRfCrSgAvD1_qxdd5aQVPMLlOmxehX_8VTrbZuX8lzptxALoTxaoIDfjKODnb2VEQefb9Lta9-c0yMzMMPY Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: be0d52e189904e3c9971960d3ff4f58b Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:15:42.503778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_be0d52e189904e3c9971960d3ff4f58b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: be0d52e189904e3c9971960d3ff4f58b Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-ServerRescueNegativeTestJSON-1544132578-project Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: ffb46379ef204df6bebd58f3bdb78ff6 Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1544132578-project Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {"volumeAttachment": {"volumeId": "80884576-4f3c-47da-9cfd-cccf9ea0fb88"}} Aug 10 23:15:42.505228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Cannot 'attach_volume' instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 while it is in vm_state rescued Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'server_id': '8a7ea374-a02e-4bdc-a8ed-02453f7dcc66', 'body': {'volumeAttachment': {'volumeId': '80884576-4f3c-47da-9cfd-cccf9ea0fb88'}}} Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:42.505936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 while it is in vm_state rescued Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:42.507214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:42.508250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:42.508250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:42.508250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 while it is in vm_state rescued Aug 10 23:15:42.508250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:15:42.508250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Returning 409 to user: Cannot 'attach_volume' instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 while it is in vm_state rescued {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:42.508250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-fb3d1964-2181-4784-a4d3-90e43f7289ee tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055819 Aug 10 23:15:42.508250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 127/259] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:15:42 2022] POST /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:15:42.515113 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-07a22a58-8b0a-472a-ae60-de464913a62c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:42.515646 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-07a22a58-8b0a-472a-ae60-de464913a62c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:42.522736 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-07a22a58-8b0a-472a-ae60-de464913a62c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.523411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-07a22a58-8b0a-472a-ae60-de464913a62c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.523982 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-07a22a58-8b0a-472a-ae60-de464913a62c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.524743 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-07a22a58-8b0a-472a-ae60-de464913a62c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.525302 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-07a22a58-8b0a-472a-ae60-de464913a62c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.525807 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-07a22a58-8b0a-472a-ae60-de464913a62c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.949841 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-07a22a58-8b0a-472a-ae60-de464913a62c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66/action" status: 202 len: 0 microversion: 2.1 time: 0.438455 Aug 10 23:15:42.951312 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 133/260] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:42 2022] POST /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:42.960262 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6b08ddc8-fefa-4d3f-8e99-6ea3cb60e61d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:42.961167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6b08ddc8-fefa-4d3f-8e99-6ea3cb60e61d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:42.967967 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b08ddc8-fefa-4d3f-8e99-6ea3cb60e61d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.968466 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b08ddc8-fefa-4d3f-8e99-6ea3cb60e61d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.968899 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b08ddc8-fefa-4d3f-8e99-6ea3cb60e61d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.969851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b08ddc8-fefa-4d3f-8e99-6ea3cb60e61d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.970311 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b08ddc8-fefa-4d3f-8e99-6ea3cb60e61d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.970761 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b08ddc8-fefa-4d3f-8e99-6ea3cb60e61d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:43.132861 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6b08ddc8-fefa-4d3f-8e99-6ea3cb60e61d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:43.140769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6b08ddc8-fefa-4d3f-8e99-6ea3cb60e61d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1510 microversion: 2.1 time: 0.185304 Aug 10 23:15:43.141340 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 128/261] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:42 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:44.162677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0cca4ecb-2317-4fa7-89aa-0cec7f81ae22 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:44.163400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0cca4ecb-2317-4fa7-89aa-0cec7f81ae22 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:44.171175 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0cca4ecb-2317-4fa7-89aa-0cec7f81ae22 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:44.171991 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0cca4ecb-2317-4fa7-89aa-0cec7f81ae22 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:44.172385 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0cca4ecb-2317-4fa7-89aa-0cec7f81ae22 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:44.173099 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0cca4ecb-2317-4fa7-89aa-0cec7f81ae22 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:44.173713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0cca4ecb-2317-4fa7-89aa-0cec7f81ae22 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:44.174140 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0cca4ecb-2317-4fa7-89aa-0cec7f81ae22 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:44.315537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0cca4ecb-2317-4fa7-89aa-0cec7f81ae22 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:44.328189 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0cca4ecb-2317-4fa7-89aa-0cec7f81ae22 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1510 microversion: 2.1 time: 0.165071 Aug 10 23:15:44.328189 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 134/262] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:44 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:45.344354 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d17f5793-f9b1-428d-9aef-3a4cc6fba934 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:45.345370 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d17f5793-f9b1-428d-9aef-3a4cc6fba934 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:45.351937 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17f5793-f9b1-428d-9aef-3a4cc6fba934 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:45.352433 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17f5793-f9b1-428d-9aef-3a4cc6fba934 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:45.352873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17f5793-f9b1-428d-9aef-3a4cc6fba934 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:45.353576 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17f5793-f9b1-428d-9aef-3a4cc6fba934 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:45.354034 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17f5793-f9b1-428d-9aef-3a4cc6fba934 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:45.354461 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17f5793-f9b1-428d-9aef-3a4cc6fba934 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:45.487761 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d17f5793-f9b1-428d-9aef-3a4cc6fba934 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:45.495308 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d17f5793-f9b1-428d-9aef-3a4cc6fba934 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1510 microversion: 2.1 time: 0.154796 Aug 10 23:15:45.495866 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 129/263] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:45 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:46.517223 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-18595983-b9d1-4e8f-84bf-408160367fe9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:46.517990 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-18595983-b9d1-4e8f-84bf-408160367fe9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:46.527801 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18595983-b9d1-4e8f-84bf-408160367fe9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:46.528424 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18595983-b9d1-4e8f-84bf-408160367fe9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:46.528943 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18595983-b9d1-4e8f-84bf-408160367fe9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:46.529805 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18595983-b9d1-4e8f-84bf-408160367fe9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:46.530339 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18595983-b9d1-4e8f-84bf-408160367fe9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:46.532958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18595983-b9d1-4e8f-84bf-408160367fe9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:46.681296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-18595983-b9d1-4e8f-84bf-408160367fe9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:46.689456 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-18595983-b9d1-4e8f-84bf-408160367fe9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1510 microversion: 2.1 time: 0.176796 Aug 10 23:15:46.690211 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 135/264] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:46 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:47.710152 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2e8ad3ed-6b75-4cfd-94f6-2b70c6f79b23 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:47.710793 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2e8ad3ed-6b75-4cfd-94f6-2b70c6f79b23 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:47.717312 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e8ad3ed-6b75-4cfd-94f6-2b70c6f79b23 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.717825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e8ad3ed-6b75-4cfd-94f6-2b70c6f79b23 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.718266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e8ad3ed-6b75-4cfd-94f6-2b70c6f79b23 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.721817 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e8ad3ed-6b75-4cfd-94f6-2b70c6f79b23 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.721817 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e8ad3ed-6b75-4cfd-94f6-2b70c6f79b23 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.721817 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e8ad3ed-6b75-4cfd-94f6-2b70c6f79b23 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.854095 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2e8ad3ed-6b75-4cfd-94f6-2b70c6f79b23 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:47.863137 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2e8ad3ed-6b75-4cfd-94f6-2b70c6f79b23 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1516 microversion: 2.1 time: 0.156785 Aug 10 23:15:47.863942 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 130/265] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:47 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:50.800764 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d7dc152f-8561-42aa-9112-3c706491d6cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'create', calling method: .version_select at 0x7fe840a3b280>, body: {"keypair": {"name": "tempest-keypair-868453007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLZ6AjKn94FFNEw1W+RBEPdapLWBWlSNebe92s5iKPoKe70qKnfA3jXlHQsUX5z7yims55novGxzSRzsRk5/IwWAqVPR5xXeGjDCyddH6U+Vi8/P6eVEsq60eLpDl+4sw=="}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:50.823465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-d7dc152f-8561-42aa-9112-3c706491d6cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Getting quotas for project be0d52e189904e3c9971960d3ff4f58b. Resources: {'key_pairs'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:15:50.828009 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-d7dc152f-8561-42aa-9112-3c706491d6cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Getting quotas for user ffb46379ef204df6bebd58f3bdb78ff6 and project be0d52e189904e3c9971960d3ff4f58b. Resources: {'key_pairs'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:15:50.958758 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d7dc152f-8561-42aa-9112-3c706491d6cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.162284 Aug 10 23:15:50.959688 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 136/266] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 10 23:15:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:53.457165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1191575963", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aba1c323-0adb-4be7-b40f-f561499325a5"}], "security_groups": [{"name": "tempest-securitygroup--441144859"}], "key_name": "tempest-keypair-868453007", "user_data": "}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:54.492541 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.network.neutron [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] validate_networks() for [('aba1c323-0adb-4be7-b40f-f561499325a5', None, None, None, None, None)] {{(pid=121332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:15:55.126754 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Flavor limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:15:55.127186 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Image limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:15:55.127669 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Flavor pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:15:55.128075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Image pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:15:55.128489 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:15:55.137189 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.137669 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.138108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.138871 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.139332 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.140258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.157406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Getting quotas for project be0d52e189904e3c9971960d3ff4f58b. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:15:55.161587 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Getting quotas for user ffb46379ef204df6bebd58f3bdb78ff6 and project be0d52e189904e3c9971960d3ff4f58b. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:15:55.172852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Going to run 1 instances... {{(pid=121332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:15:55.175149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:15:55.376365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4b3f5480-b444-4292-8d81-c03405d0afef tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.924222 Aug 10 23:15:55.377168 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 131/267] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:15:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:15:55.388078 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e3fc38e3-02be-4582-9347-05ff2864fc0f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:55.388723 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e3fc38e3-02be-4582-9347-05ff2864fc0f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:55.441378 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e3fc38e3-02be-4582-9347-05ff2864fc0f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:55.448547 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e3fc38e3-02be-4582-9347-05ff2864fc0f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1245 microversion: 2.1 time: 0.064581 Aug 10 23:15:55.449103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 137/268] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:55 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1245 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:56.469431 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4149cac1-a473-408e-833d-86926d97c06a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:56.470226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4149cac1-a473-408e-833d-86926d97c06a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:56.478164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4149cac1-a473-408e-833d-86926d97c06a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:56.478648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4149cac1-a473-408e-833d-86926d97c06a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:56.479108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4149cac1-a473-408e-833d-86926d97c06a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:56.479803 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4149cac1-a473-408e-833d-86926d97c06a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:56.480267 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4149cac1-a473-408e-833d-86926d97c06a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:56.480722 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4149cac1-a473-408e-833d-86926d97c06a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:56.544607 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4149cac1-a473-408e-833d-86926d97c06a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:56.552587 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4149cac1-a473-408e-833d-86926d97c06a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1249 microversion: 2.1 time: 0.087202 Aug 10 23:15:56.553142 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 132/269] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:56 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:57.573731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0e701d19-6039-46d3-b7cc-e5e70d46ccaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:57.574854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0e701d19-6039-46d3-b7cc-e5e70d46ccaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:57.576955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:57.582525 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0e701d19-6039-46d3-b7cc-e5e70d46ccaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:57.583471 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0e701d19-6039-46d3-b7cc-e5e70d46ccaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:57.584205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0e701d19-6039-46d3-b7cc-e5e70d46ccaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:57.585495 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0e701d19-6039-46d3-b7cc-e5e70d46ccaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:57.586316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0e701d19-6039-46d3-b7cc-e5e70d46ccaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:57.587137 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0e701d19-6039-46d3-b7cc-e5e70d46ccaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:57.670400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0e701d19-6039-46d3-b7cc-e5e70d46ccaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:57.679444 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0e701d19-6039-46d3-b7cc-e5e70d46ccaf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1305 microversion: 2.1 time: 0.109849 Aug 10 23:15:57.687424 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 138/270] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:57 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:58.701357 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7af2620d-af43-48c4-adfb-f465fd0712b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:58.702062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7af2620d-af43-48c4-adfb-f465fd0712b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:58.709132 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7af2620d-af43-48c4-adfb-f465fd0712b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.709702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7af2620d-af43-48c4-adfb-f465fd0712b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.710223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7af2620d-af43-48c4-adfb-f465fd0712b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.711019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7af2620d-af43-48c4-adfb-f465fd0712b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.711553 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7af2620d-af43-48c4-adfb-f465fd0712b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.712054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7af2620d-af43-48c4-adfb-f465fd0712b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.927648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7af2620d-af43-48c4-adfb-f465fd0712b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:58.935144 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7af2620d-af43-48c4-adfb-f465fd0712b1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.237701 Aug 10 23:15:58.935947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 133/271] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:58 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:59.339844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-1f8cee67-04e5-4765-afc0-c837d4d62401 req-c9fc0c94-bc02-4157-b549-bca022a85f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f942a5b6-08d7-4d52-a7bd-1af4aaba1930", "tag": "a4fdf480-4b42-4de5-8380-f1aec638d9a7"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:59.346259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:59.351962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-1f8cee67-04e5-4765-afc0-c837d4d62401 req-c9fc0c94-bc02-4157-b549-bca022a85f3d service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:59.352461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-1f8cee67-04e5-4765-afc0-c837d4d62401 req-c9fc0c94-bc02-4157-b549-bca022a85f3d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:59.352875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-1f8cee67-04e5-4765-afc0-c837d4d62401 req-c9fc0c94-bc02-4157-b549-bca022a85f3d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:59.364242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-1f8cee67-04e5-4765-afc0-c837d4d62401 req-c9fc0c94-bc02-4157-b549-bca022a85f3d service nova] Creating event network-changed:a4fdf480-4b42-4de5-8380-f1aec638d9a7 for instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 on hv-cinder-85144 Aug 10 23:15:59.369814 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-1f8cee67-04e5-4765-afc0-c837d4d62401 req-c9fc0c94-bc02-4157-b549-bca022a85f3d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033644 Aug 10 23:15:59.372201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 139/272] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:15:59.966515 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-aa246d21-6b09-4033-9f64-5072a801abb2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:59.967148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-aa246d21-6b09-4033-9f64-5072a801abb2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:59.970355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:59.975092 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa246d21-6b09-4033-9f64-5072a801abb2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:59.975569 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa246d21-6b09-4033-9f64-5072a801abb2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:59.976000 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa246d21-6b09-4033-9f64-5072a801abb2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:59.976683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa246d21-6b09-4033-9f64-5072a801abb2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:59.977132 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa246d21-6b09-4033-9f64-5072a801abb2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:59.977593 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa246d21-6b09-4033-9f64-5072a801abb2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:00.104346 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-aa246d21-6b09-4033-9f64-5072a801abb2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:00.112387 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-aa246d21-6b09-4033-9f64-5072a801abb2 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.149635 Aug 10 23:16:00.112949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 134/273] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:59 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:01.133901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0623950d-2c8f-45e1-b1d9-a156306c2cbb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:01.134596 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0623950d-2c8f-45e1-b1d9-a156306c2cbb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:01.141679 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0623950d-2c8f-45e1-b1d9-a156306c2cbb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:01.142150 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0623950d-2c8f-45e1-b1d9-a156306c2cbb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:01.142577 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0623950d-2c8f-45e1-b1d9-a156306c2cbb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:01.143285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0623950d-2c8f-45e1-b1d9-a156306c2cbb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:01.143738 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0623950d-2c8f-45e1-b1d9-a156306c2cbb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:01.150818 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0623950d-2c8f-45e1-b1d9-a156306c2cbb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:01.278171 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0623950d-2c8f-45e1-b1d9-a156306c2cbb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:01.286008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0623950d-2c8f-45e1-b1d9-a156306c2cbb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.156997 Aug 10 23:16:01.286569 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 140/274] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:01 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:02.307182 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-70e07308-13c8-443e-8527-77620980204f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:02.307801 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-70e07308-13c8-443e-8527-77620980204f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:02.314063 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-70e07308-13c8-443e-8527-77620980204f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:02.314547 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-70e07308-13c8-443e-8527-77620980204f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:02.315021 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-70e07308-13c8-443e-8527-77620980204f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:02.315719 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-70e07308-13c8-443e-8527-77620980204f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:02.316183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-70e07308-13c8-443e-8527-77620980204f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:02.316619 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-70e07308-13c8-443e-8527-77620980204f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:02.450881 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-70e07308-13c8-443e-8527-77620980204f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:02.454389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-70e07308-13c8-443e-8527-77620980204f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.151773 Aug 10 23:16:02.454992 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 135/275] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:02 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:03.514789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a90da0fa-a231-4663-88e9-c7d7f482417e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:03.514789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a90da0fa-a231-4663-88e9-c7d7f482417e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:03.514789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a90da0fa-a231-4663-88e9-c7d7f482417e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:03.514789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a90da0fa-a231-4663-88e9-c7d7f482417e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:03.515542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a90da0fa-a231-4663-88e9-c7d7f482417e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:03.515542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a90da0fa-a231-4663-88e9-c7d7f482417e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:03.515542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a90da0fa-a231-4663-88e9-c7d7f482417e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:03.515542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a90da0fa-a231-4663-88e9-c7d7f482417e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:03.625752 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a90da0fa-a231-4663-88e9-c7d7f482417e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:03.634006 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a90da0fa-a231-4663-88e9-c7d7f482417e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.163168 Aug 10 23:16:03.634557 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 141/276] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:03 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:04.653842 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5bc2f890-7e62-4233-9548-e4a90367ffb8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:04.654455 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5bc2f890-7e62-4233-9548-e4a90367ffb8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:04.661610 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5bc2f890-7e62-4233-9548-e4a90367ffb8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:04.662095 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5bc2f890-7e62-4233-9548-e4a90367ffb8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:04.662532 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5bc2f890-7e62-4233-9548-e4a90367ffb8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:04.663324 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5bc2f890-7e62-4233-9548-e4a90367ffb8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:04.663780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5bc2f890-7e62-4233-9548-e4a90367ffb8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:04.664207 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5bc2f890-7e62-4233-9548-e4a90367ffb8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:04.796143 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5bc2f890-7e62-4233-9548-e4a90367ffb8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:04.800165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5bc2f890-7e62-4233-9548-e4a90367ffb8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.150341 Aug 10 23:16:04.800726 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 136/277] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:04 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:05.820875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-929e5e62-86d2-4afc-8964-33937d340379 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:05.821585 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-929e5e62-86d2-4afc-8964-33937d340379 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:05.823654 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=6 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:05.829141 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-929e5e62-86d2-4afc-8964-33937d340379 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:05.829141 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-929e5e62-86d2-4afc-8964-33937d340379 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:05.829577 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-929e5e62-86d2-4afc-8964-33937d340379 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:05.830292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-929e5e62-86d2-4afc-8964-33937d340379 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:05.830968 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-929e5e62-86d2-4afc-8964-33937d340379 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:05.831404 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-929e5e62-86d2-4afc-8964-33937d340379 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:05.960717 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-929e5e62-86d2-4afc-8964-33937d340379 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:05.968083 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-929e5e62-86d2-4afc-8964-33937d340379 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.151740 Aug 10 23:16:05.968644 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 142/278] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:05 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:06.990084 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-292d732a-b94a-4ea7-afa8-1f7b046ed440 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:06.990759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-292d732a-b94a-4ea7-afa8-1f7b046ed440 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:06.992622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:06.993328 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=6 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:06.998709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-292d732a-b94a-4ea7-afa8-1f7b046ed440 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:06.999198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-292d732a-b94a-4ea7-afa8-1f7b046ed440 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:06.999642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-292d732a-b94a-4ea7-afa8-1f7b046ed440 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:07.000365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-292d732a-b94a-4ea7-afa8-1f7b046ed440 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:07.000812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-292d732a-b94a-4ea7-afa8-1f7b046ed440 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:07.001241 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-292d732a-b94a-4ea7-afa8-1f7b046ed440 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:07.007375 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=72 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:07.139071 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-292d732a-b94a-4ea7-afa8-1f7b046ed440 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:07.146686 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-292d732a-b94a-4ea7-afa8-1f7b046ed440 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.160968 Aug 10 23:16:07.147277 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 137/279] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:06 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:08.167723 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6f96ffb1-e12d-46c9-8c9e-52124bdc0e74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:08.172073 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6f96ffb1-e12d-46c9-8c9e-52124bdc0e74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:08.174460 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f96ffb1-e12d-46c9-8c9e-52124bdc0e74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:08.174967 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f96ffb1-e12d-46c9-8c9e-52124bdc0e74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:08.175403 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f96ffb1-e12d-46c9-8c9e-52124bdc0e74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:08.176084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f96ffb1-e12d-46c9-8c9e-52124bdc0e74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:08.176532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f96ffb1-e12d-46c9-8c9e-52124bdc0e74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:08.176950 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f96ffb1-e12d-46c9-8c9e-52124bdc0e74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:08.303448 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6f96ffb1-e12d-46c9-8c9e-52124bdc0e74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:08.310769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6f96ffb1-e12d-46c9-8c9e-52124bdc0e74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.146840 Aug 10 23:16:08.311333 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 143/280] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:08 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:09.331873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c431dd28-fab9-49a2-8be0-82a7780ae535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:09.332489 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c431dd28-fab9-49a2-8be0-82a7780ae535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:09.339147 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c431dd28-fab9-49a2-8be0-82a7780ae535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:09.339635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c431dd28-fab9-49a2-8be0-82a7780ae535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:09.340076 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c431dd28-fab9-49a2-8be0-82a7780ae535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:09.340771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c431dd28-fab9-49a2-8be0-82a7780ae535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:09.341233 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c431dd28-fab9-49a2-8be0-82a7780ae535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:09.341662 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c431dd28-fab9-49a2-8be0-82a7780ae535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:09.472797 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c431dd28-fab9-49a2-8be0-82a7780ae535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:09.480639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c431dd28-fab9-49a2-8be0-82a7780ae535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.153009 Aug 10 23:16:09.481208 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 138/281] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:09 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:10.501654 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-17c0ad1c-057d-4226-91bd-5eb1db45583d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:10.502260 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-17c0ad1c-057d-4226-91bd-5eb1db45583d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:10.508131 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-17c0ad1c-057d-4226-91bd-5eb1db45583d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:10.508605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-17c0ad1c-057d-4226-91bd-5eb1db45583d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:10.509034 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-17c0ad1c-057d-4226-91bd-5eb1db45583d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:10.509728 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-17c0ad1c-057d-4226-91bd-5eb1db45583d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:10.510156 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-17c0ad1c-057d-4226-91bd-5eb1db45583d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:10.510635 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-17c0ad1c-057d-4226-91bd-5eb1db45583d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:10.637009 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-17c0ad1c-057d-4226-91bd-5eb1db45583d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:10.644380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-17c0ad1c-057d-4226-91bd-5eb1db45583d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.146721 Aug 10 23:16:10.644948 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 144/282] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:10 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:11.665212 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9086e52a-5ffe-4cf0-834d-e3cb0013bb0a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:11.665829 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9086e52a-5ffe-4cf0-834d-e3cb0013bb0a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:11.672916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9086e52a-5ffe-4cf0-834d-e3cb0013bb0a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:11.673399 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9086e52a-5ffe-4cf0-834d-e3cb0013bb0a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:11.673839 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9086e52a-5ffe-4cf0-834d-e3cb0013bb0a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:11.674538 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9086e52a-5ffe-4cf0-834d-e3cb0013bb0a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:11.675029 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9086e52a-5ffe-4cf0-834d-e3cb0013bb0a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:11.675482 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9086e52a-5ffe-4cf0-834d-e3cb0013bb0a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:11.804281 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-9086e52a-5ffe-4cf0-834d-e3cb0013bb0a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:11.811752 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9086e52a-5ffe-4cf0-834d-e3cb0013bb0a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.150441 Aug 10 23:16:11.812320 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 139/283] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:11 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:12.838197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-16ebca3c-e63e-437f-b767-8501478a45d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:12.838197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-16ebca3c-e63e-437f-b767-8501478a45d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:12.839042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16ebca3c-e63e-437f-b767-8501478a45d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:12.839531 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16ebca3c-e63e-437f-b767-8501478a45d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:12.839974 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16ebca3c-e63e-437f-b767-8501478a45d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.840684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16ebca3c-e63e-437f-b767-8501478a45d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:12.841150 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16ebca3c-e63e-437f-b767-8501478a45d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:12.841584 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16ebca3c-e63e-437f-b767-8501478a45d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.969994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-16ebca3c-e63e-437f-b767-8501478a45d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:12.977245 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-16ebca3c-e63e-437f-b767-8501478a45d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.149057 Aug 10 23:16:12.977807 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 145/284] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:12 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:13.998015 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8326c54c-217e-4dac-a440-24da1dc45de0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:13.998683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8326c54c-217e-4dac-a440-24da1dc45de0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:14.005177 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8326c54c-217e-4dac-a440-24da1dc45de0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:14.005657 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8326c54c-217e-4dac-a440-24da1dc45de0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:14.006094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8326c54c-217e-4dac-a440-24da1dc45de0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:14.006822 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8326c54c-217e-4dac-a440-24da1dc45de0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:14.007279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8326c54c-217e-4dac-a440-24da1dc45de0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:14.007706 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8326c54c-217e-4dac-a440-24da1dc45de0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:14.144556 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8326c54c-217e-4dac-a440-24da1dc45de0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:14.152026 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8326c54c-217e-4dac-a440-24da1dc45de0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.158541 Aug 10 23:16:14.152594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 140/285] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:13 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:15.172181 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c880fb13-17f9-4af9-a44f-acb9cfcdb584 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:15.172795 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c880fb13-17f9-4af9-a44f-acb9cfcdb584 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:15.178873 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c880fb13-17f9-4af9-a44f-acb9cfcdb584 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:15.179365 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c880fb13-17f9-4af9-a44f-acb9cfcdb584 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:15.179806 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c880fb13-17f9-4af9-a44f-acb9cfcdb584 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:15.180504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c880fb13-17f9-4af9-a44f-acb9cfcdb584 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:15.180964 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c880fb13-17f9-4af9-a44f-acb9cfcdb584 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:15.181394 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c880fb13-17f9-4af9-a44f-acb9cfcdb584 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:15.322594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c880fb13-17f9-4af9-a44f-acb9cfcdb584 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:15.331619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c880fb13-17f9-4af9-a44f-acb9cfcdb584 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.163064 Aug 10 23:16:15.332313 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 146/286] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:15 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:16.351955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1007c7b6-9447-4c8a-9b41-8d2c8f30fdc4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:16.352561 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1007c7b6-9447-4c8a-9b41-8d2c8f30fdc4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:16.359435 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1007c7b6-9447-4c8a-9b41-8d2c8f30fdc4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:16.359910 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1007c7b6-9447-4c8a-9b41-8d2c8f30fdc4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:16.360342 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1007c7b6-9447-4c8a-9b41-8d2c8f30fdc4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:16.362845 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1007c7b6-9447-4c8a-9b41-8d2c8f30fdc4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:16.362845 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1007c7b6-9447-4c8a-9b41-8d2c8f30fdc4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:16.362845 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1007c7b6-9447-4c8a-9b41-8d2c8f30fdc4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:16.494148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1007c7b6-9447-4c8a-9b41-8d2c8f30fdc4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:16.502121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1007c7b6-9447-4c8a-9b41-8d2c8f30fdc4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.153990 Aug 10 23:16:16.502925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 141/287] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:16 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:17.522460 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f804357b-77df-4920-84ca-41157e7e8f88 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:17.523115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f804357b-77df-4920-84ca-41157e7e8f88 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:17.529254 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f804357b-77df-4920-84ca-41157e7e8f88 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:17.529682 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f804357b-77df-4920-84ca-41157e7e8f88 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:17.530121 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f804357b-77df-4920-84ca-41157e7e8f88 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:17.530852 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f804357b-77df-4920-84ca-41157e7e8f88 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:17.531314 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f804357b-77df-4920-84ca-41157e7e8f88 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:17.531746 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f804357b-77df-4920-84ca-41157e7e8f88 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:17.663364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f804357b-77df-4920-84ca-41157e7e8f88 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:17.670868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f804357b-77df-4920-84ca-41157e7e8f88 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.152173 Aug 10 23:16:17.671494 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 147/288] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:17 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:18.692615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-bd757930-0565-4d49-a7bb-07ca70f5cdbf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:18.693265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bd757930-0565-4d49-a7bb-07ca70f5cdbf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:18.700791 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bd757930-0565-4d49-a7bb-07ca70f5cdbf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:18.701373 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bd757930-0565-4d49-a7bb-07ca70f5cdbf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:18.701810 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bd757930-0565-4d49-a7bb-07ca70f5cdbf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:18.702596 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bd757930-0565-4d49-a7bb-07ca70f5cdbf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:18.703125 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bd757930-0565-4d49-a7bb-07ca70f5cdbf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:18.703552 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bd757930-0565-4d49-a7bb-07ca70f5cdbf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:18.832230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-bd757930-0565-4d49-a7bb-07ca70f5cdbf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:18.839874 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-bd757930-0565-4d49-a7bb-07ca70f5cdbf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.152016 Aug 10 23:16:18.840441 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 142/289] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:18 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:19.860839 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-59993e64-de63-4e69-a476-88e59f6482f4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:19.861483 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-59993e64-de63-4e69-a476-88e59f6482f4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:19.867479 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59993e64-de63-4e69-a476-88e59f6482f4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:19.871760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59993e64-de63-4e69-a476-88e59f6482f4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:19.871760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59993e64-de63-4e69-a476-88e59f6482f4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:19.871760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59993e64-de63-4e69-a476-88e59f6482f4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:19.871760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59993e64-de63-4e69-a476-88e59f6482f4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:19.872146 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-59993e64-de63-4e69-a476-88e59f6482f4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:19.997565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-59993e64-de63-4e69-a476-88e59f6482f4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:20.005526 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-59993e64-de63-4e69-a476-88e59f6482f4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.148829 Aug 10 23:16:20.006091 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 148/290] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:19 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:20.384482 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-c4e3f55d-6d4d-4c4f-945b-9a4b1d011355 req-c9a1bd55-cef3-4225-bbbf-fdb45a855ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f942a5b6-08d7-4d52-a7bd-1af4aaba1930", "name": "network-vif-plugged", "status": "completed", "tag": "a4fdf480-4b42-4de5-8380-f1aec638d9a7"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:20.394444 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-c4e3f55d-6d4d-4c4f-945b-9a4b1d011355 req-c9a1bd55-cef3-4225-bbbf-fdb45a855ca4 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:20.394971 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-c4e3f55d-6d4d-4c4f-945b-9a4b1d011355 req-c9a1bd55-cef3-4225-bbbf-fdb45a855ca4 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:20.395432 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-c4e3f55d-6d4d-4c4f-945b-9a4b1d011355 req-c9a1bd55-cef3-4225-bbbf-fdb45a855ca4 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:20.406098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-c4e3f55d-6d4d-4c4f-945b-9a4b1d011355 req-c9a1bd55-cef3-4225-bbbf-fdb45a855ca4 service nova] Creating event network-vif-plugged:a4fdf480-4b42-4de5-8380-f1aec638d9a7 for instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 on hv-cinder-85144 Aug 10 23:16:20.411485 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-c4e3f55d-6d4d-4c4f-945b-9a4b1d011355 req-c9a1bd55-cef3-4225-bbbf-fdb45a855ca4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030639 Aug 10 23:16:20.412156 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 143/291] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:21.026184 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4ad6a771-e10c-4c56-96c3-da454554bc6a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:21.026774 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4ad6a771-e10c-4c56-96c3-da454554bc6a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:21.033319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4ad6a771-e10c-4c56-96c3-da454554bc6a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:21.033805 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4ad6a771-e10c-4c56-96c3-da454554bc6a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:21.034249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4ad6a771-e10c-4c56-96c3-da454554bc6a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:21.034979 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4ad6a771-e10c-4c56-96c3-da454554bc6a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:21.035438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4ad6a771-e10c-4c56-96c3-da454554bc6a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:21.035879 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4ad6a771-e10c-4c56-96c3-da454554bc6a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:21.171942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4ad6a771-e10c-4c56-96c3-da454554bc6a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:21.179695 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4ad6a771-e10c-4c56-96c3-da454554bc6a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.157405 Aug 10 23:16:21.180342 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 149/292] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:21 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:22.201203 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1c82d8d1-db36-4557-ac88-4c5ddbe52993 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:22.201898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1c82d8d1-db36-4557-ac88-4c5ddbe52993 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:22.208678 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c82d8d1-db36-4557-ac88-4c5ddbe52993 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:22.209163 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c82d8d1-db36-4557-ac88-4c5ddbe52993 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:22.209596 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c82d8d1-db36-4557-ac88-4c5ddbe52993 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:22.210296 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c82d8d1-db36-4557-ac88-4c5ddbe52993 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:22.210778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c82d8d1-db36-4557-ac88-4c5ddbe52993 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:22.211201 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c82d8d1-db36-4557-ac88-4c5ddbe52993 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:22.348128 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1c82d8d1-db36-4557-ac88-4c5ddbe52993 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:22.356469 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1c82d8d1-db36-4557-ac88-4c5ddbe52993 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1370 microversion: 2.1 time: 0.159554 Aug 10 23:16:22.357042 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 144/293] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:22 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:23.376606 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1559a3c8-e6ff-4d70-a294-f8f6dd114bcc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:23.377243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1559a3c8-e6ff-4d70-a294-f8f6dd114bcc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:23.383277 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1559a3c8-e6ff-4d70-a294-f8f6dd114bcc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:23.383763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1559a3c8-e6ff-4d70-a294-f8f6dd114bcc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:23.384202 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1559a3c8-e6ff-4d70-a294-f8f6dd114bcc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:23.384893 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1559a3c8-e6ff-4d70-a294-f8f6dd114bcc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:23.385346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1559a3c8-e6ff-4d70-a294-f8f6dd114bcc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:23.385772 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1559a3c8-e6ff-4d70-a294-f8f6dd114bcc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:23.515744 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1559a3c8-e6ff-4d70-a294-f8f6dd114bcc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:23.523243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1559a3c8-e6ff-4d70-a294-f8f6dd114bcc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1564 microversion: 2.1 time: 0.150553 Aug 10 23:16:23.523806 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 150/294] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:23 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:23.543042 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-152498be-ba2c-4577-acfc-fc5d7f7e8c55 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:23.543562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-152498be-ba2c-4577-acfc-fc5d7f7e8c55 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:23.549980 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-152498be-ba2c-4577-acfc-fc5d7f7e8c55 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:23.550456 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-152498be-ba2c-4577-acfc-fc5d7f7e8c55 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:23.550936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-152498be-ba2c-4577-acfc-fc5d7f7e8c55 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:23.551621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-152498be-ba2c-4577-acfc-fc5d7f7e8c55 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:23.552068 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-152498be-ba2c-4577-acfc-fc5d7f7e8c55 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:23.552486 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-152498be-ba2c-4577-acfc-fc5d7f7e8c55 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:23.629874 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-152498be-ba2c-4577-acfc-fc5d7f7e8c55 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090663 Aug 10 23:16:23.630478 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 145/295] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 10 23:16:23 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:24.834895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-967a516a-8a6c-49d1-a2f5-ee36ba980c46 req-b7393936-5b71-43d6-8444-c80b7ad812d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f942a5b6-08d7-4d52-a7bd-1af4aaba1930", "tag": "a4fdf480-4b42-4de5-8380-f1aec638d9a7"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:24.845865 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-967a516a-8a6c-49d1-a2f5-ee36ba980c46 req-b7393936-5b71-43d6-8444-c80b7ad812d8 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:24.846342 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-967a516a-8a6c-49d1-a2f5-ee36ba980c46 req-b7393936-5b71-43d6-8444-c80b7ad812d8 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:24.847036 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-967a516a-8a6c-49d1-a2f5-ee36ba980c46 req-b7393936-5b71-43d6-8444-c80b7ad812d8 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:24.861420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-967a516a-8a6c-49d1-a2f5-ee36ba980c46 req-b7393936-5b71-43d6-8444-c80b7ad812d8 service nova] Creating event network-changed:a4fdf480-4b42-4de5-8380-f1aec638d9a7 for instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 on hv-cinder-85144 Aug 10 23:16:24.866838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-967a516a-8a6c-49d1-a2f5-ee36ba980c46 req-b7393936-5b71-43d6-8444-c80b7ad812d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035784 Aug 10 23:16:24.867529 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 151/296] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:51.164424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=23 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:51.168483 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=47 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:51.169609 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-797498253", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:51.224121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.network.neutron [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] validate_networks() for None {{(pid=121332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:16:51.784233 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Flavor limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:16:51.785218 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Image limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:16:51.785822 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Flavor pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:16:51.786243 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Image pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:16:51.786691 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:16:51.795927 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:51.796415 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:51.796858 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:51.797588 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:51.798232 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:51.798895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:51.816356 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Getting quotas for project ea931246f8e74f6ab520b032fe2c5a3e. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:16:51.821478 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Getting quotas for user 4d7de9e785544d14a901cd1c3e1d8bd0 and project ea931246f8e74f6ab520b032fe2c5a3e. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:16:51.833073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Going to run 1 instances... {{(pid=121332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:16:51.835366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:16:51.969638 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7288b61b-c044-494c-9ed4-ade923cc544a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806830 Aug 10 23:16:51.970544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 146/297] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:16:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:16:51.978583 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=25 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:51.979357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=76 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:51.983324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7b48f916-09ea-4673-b86e-3376f24f182d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:51.984222 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7b48f916-09ea-4673-b86e-3376f24f182d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:52.038061 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7b48f916-09ea-4673-b86e-3376f24f182d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:52.045596 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7b48f916-09ea-4673-b86e-3376f24f182d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1214 microversion: 2.1 time: 0.068062 Aug 10 23:16:52.046168 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 152/298] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:51 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:53.066928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4e9b91d6-f2a8-44e7-8645-5400eaa5c0c6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:53.068151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4e9b91d6-f2a8-44e7-8645-5400eaa5c0c6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:53.130822 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4e9b91d6-f2a8-44e7-8645-5400eaa5c0c6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:53.138565 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4e9b91d6-f2a8-44e7-8645-5400eaa5c0c6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1214 microversion: 2.1 time: 0.076269 Aug 10 23:16:53.139128 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 147/299] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:53 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:53.681960 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:16:53.682245 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Wed Aug 10 23:16:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:16:54.158823 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-55ec10d5-6d31-415d-bb4d-b919e9455166 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:54.159438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-55ec10d5-6d31-415d-bb4d-b919e9455166 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:54.211229 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-55ec10d5-6d31-415d-bb4d-b919e9455166 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:54.217997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-55ec10d5-6d31-415d-bb4d-b919e9455166 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1214 microversion: 2.1 time: 0.063206 Aug 10 23:16:54.218555 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 153/300] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:54 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:55.239053 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d00bbb37-8f65-4a4b-8ae4-5e050d354c50 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:55.240444 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d00bbb37-8f65-4a4b-8ae4-5e050d354c50 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:55.293075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d00bbb37-8f65-4a4b-8ae4-5e050d354c50 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:55.299743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d00bbb37-8f65-4a4b-8ae4-5e050d354c50 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1214 microversion: 2.1 time: 0.064578 Aug 10 23:16:55.300297 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 148/301] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:55 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:55.459447 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1286873678", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "networks": [{"uuid": "54dcd3e9-ed60-408a-8724-5d172a7753ab"}]}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:55.513211 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] validate_networks() for [('54dcd3e9-ed60-408a-8724-5d172a7753ab', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:16:55.857543 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:16:55.858110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:16:55.858715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:16:55.859198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:16:55.859684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:16:55.868641 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:55.869210 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:55.869718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:55.870543 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:55.871110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:55.871606 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:55.890002 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Getting quotas for project 48dcf02947bd4522ac6886d8a0ca63ba. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:16:55.892800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Getting quotas for user 50cf4af54ca0488ebb6bb0f7c33d6d58 and project 48dcf02947bd4522ac6886d8a0ca63ba. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:16:55.904144 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:16:55.906437 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:16:56.012251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:16:56.014100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Wed Aug 10 23:16:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Aug 10 23:16:56.023917 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0eee9ee7-b3f8-460e-9357-a6714fc420cc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568812 Aug 10 23:16:56.024549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 154/302] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:16:56.035071 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d11c748c-0cca-4659-82c2-d21318c137d5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:56.035679 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d11c748c-0cca-4659-82c2-d21318c137d5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:56.092878 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d11c748c-0cca-4659-82c2-d21318c137d5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:56.100746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d11c748c-0cca-4659-82c2-d21318c137d5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1214 microversion: 2.1 time: 0.069389 Aug 10 23:16:56.101310 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 149/303] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:56 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:56.320928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c26e8b48-8d57-48a5-902d-64623469e806 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:56.321469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c26e8b48-8d57-48a5-902d-64623469e806 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:56.327971 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c26e8b48-8d57-48a5-902d-64623469e806 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:56.328452 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c26e8b48-8d57-48a5-902d-64623469e806 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:56.328888 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c26e8b48-8d57-48a5-902d-64623469e806 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:56.329578 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c26e8b48-8d57-48a5-902d-64623469e806 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:56.330032 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c26e8b48-8d57-48a5-902d-64623469e806 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:56.330457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c26e8b48-8d57-48a5-902d-64623469e806 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:56.391406 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c26e8b48-8d57-48a5-902d-64623469e806 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:56.399642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c26e8b48-8d57-48a5-902d-64623469e806 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1218 microversion: 2.1 time: 0.083411 Aug 10 23:16:56.400205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 155/304] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:56 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:57.123860 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-831e242f-3672-43a8-bae9-2a88d863f4ce tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:57.124501 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-831e242f-3672-43a8-bae9-2a88d863f4ce tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:57.193335 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-831e242f-3672-43a8-bae9-2a88d863f4ce tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:57.200116 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-831e242f-3672-43a8-bae9-2a88d863f4ce tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1214 microversion: 2.1 time: 0.080434 Aug 10 23:16:57.200683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 150/305] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:57 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:57.424369 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ec989600-9f48-4080-a311-6b19a28cb357 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:57.424369 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ec989600-9f48-4080-a311-6b19a28cb357 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:57.426923 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ec989600-9f48-4080-a311-6b19a28cb357 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:57.428135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ec989600-9f48-4080-a311-6b19a28cb357 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:57.428517 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ec989600-9f48-4080-a311-6b19a28cb357 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:57.429182 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ec989600-9f48-4080-a311-6b19a28cb357 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:57.429630 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ec989600-9f48-4080-a311-6b19a28cb357 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:57.430045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ec989600-9f48-4080-a311-6b19a28cb357 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:57.491306 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ec989600-9f48-4080-a311-6b19a28cb357 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:57.498549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ec989600-9f48-4080-a311-6b19a28cb357 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1218 microversion: 2.1 time: 0.082759 Aug 10 23:16:57.499140 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 156/306] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:57 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:58.221459 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b34fe02b-eeaa-49ee-9ac1-a3614f6e119a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:58.222103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b34fe02b-eeaa-49ee-9ac1-a3614f6e119a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:58.229334 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b34fe02b-eeaa-49ee-9ac1-a3614f6e119a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:58.230104 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b34fe02b-eeaa-49ee-9ac1-a3614f6e119a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:58.230584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b34fe02b-eeaa-49ee-9ac1-a3614f6e119a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.231351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b34fe02b-eeaa-49ee-9ac1-a3614f6e119a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:58.231928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b34fe02b-eeaa-49ee-9ac1-a3614f6e119a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:58.232447 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b34fe02b-eeaa-49ee-9ac1-a3614f6e119a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.297787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b34fe02b-eeaa-49ee-9ac1-a3614f6e119a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:58.305260 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b34fe02b-eeaa-49ee-9ac1-a3614f6e119a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1266 microversion: 2.1 time: 0.087924 Aug 10 23:16:58.305807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 151/307] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:58 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:58.525454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1c0b4a30-50bb-4438-b116-1c861bf284d7 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:58.526024 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1c0b4a30-50bb-4438-b116-1c861bf284d7 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:58.532321 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c0b4a30-50bb-4438-b116-1c861bf284d7 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:58.532808 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c0b4a30-50bb-4438-b116-1c861bf284d7 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:58.533461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c0b4a30-50bb-4438-b116-1c861bf284d7 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.533974 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c0b4a30-50bb-4438-b116-1c861bf284d7 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:58.534687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c0b4a30-50bb-4438-b116-1c861bf284d7 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:58.535466 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c0b4a30-50bb-4438-b116-1c861bf284d7 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.600437 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1c0b4a30-50bb-4438-b116-1c861bf284d7 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:58.608160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1c0b4a30-50bb-4438-b116-1c861bf284d7 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1266 microversion: 2.1 time: 0.086743 Aug 10 23:16:58.609311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 157/308] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:58 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:59.325738 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8001caf5-df65-4516-90df-84e6186ae930 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:59.326374 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8001caf5-df65-4516-90df-84e6186ae930 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:59.333649 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8001caf5-df65-4516-90df-84e6186ae930 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:59.334361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8001caf5-df65-4516-90df-84e6186ae930 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:59.334860 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8001caf5-df65-4516-90df-84e6186ae930 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:59.336007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8001caf5-df65-4516-90df-84e6186ae930 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:59.336478 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8001caf5-df65-4516-90df-84e6186ae930 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:59.336900 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8001caf5-df65-4516-90df-84e6186ae930 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:59.419534 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8001caf5-df65-4516-90df-84e6186ae930 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:59.427758 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8001caf5-df65-4516-90df-84e6186ae930 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1272 microversion: 2.1 time: 0.105817 Aug 10 23:16:59.428553 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 152/309] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:59 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:59.632391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3fc9d00d-581c-47d6-83e3-9fff79287bd2 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:59.633669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3fc9d00d-581c-47d6-83e3-9fff79287bd2 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:59.639694 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3fc9d00d-581c-47d6-83e3-9fff79287bd2 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:59.640242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3fc9d00d-581c-47d6-83e3-9fff79287bd2 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:59.640679 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3fc9d00d-581c-47d6-83e3-9fff79287bd2 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:59.641385 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3fc9d00d-581c-47d6-83e3-9fff79287bd2 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:59.641840 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3fc9d00d-581c-47d6-83e3-9fff79287bd2 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:59.642755 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3fc9d00d-581c-47d6-83e3-9fff79287bd2 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:59.727170 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3fc9d00d-581c-47d6-83e3-9fff79287bd2 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:59.734770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3fc9d00d-581c-47d6-83e3-9fff79287bd2 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1272 microversion: 2.1 time: 0.106229 Aug 10 23:16:59.735347 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 158/310] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:59 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:00.448025 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-be4823b9-930a-4104-a801-d32a8a0ff61c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:00.448728 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-be4823b9-930a-4104-a801-d32a8a0ff61c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:00.455222 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-be4823b9-930a-4104-a801-d32a8a0ff61c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:00.455709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-be4823b9-930a-4104-a801-d32a8a0ff61c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:00.456294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-be4823b9-930a-4104-a801-d32a8a0ff61c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:00.457015 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-be4823b9-930a-4104-a801-d32a8a0ff61c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:00.457468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-be4823b9-930a-4104-a801-d32a8a0ff61c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:00.458501 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-be4823b9-930a-4104-a801-d32a8a0ff61c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:00.760138 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fb5d9251-4892-4f8b-b7ed-db55f48088ba tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:00.760885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-fb5d9251-4892-4f8b-b7ed-db55f48088ba tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:00.766699 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb5d9251-4892-4f8b-b7ed-db55f48088ba tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:00.767326 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb5d9251-4892-4f8b-b7ed-db55f48088ba tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:00.767760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb5d9251-4892-4f8b-b7ed-db55f48088ba tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:00.768454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb5d9251-4892-4f8b-b7ed-db55f48088ba tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:00.768904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb5d9251-4892-4f8b-b7ed-db55f48088ba tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:00.769324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb5d9251-4892-4f8b-b7ed-db55f48088ba tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:00.790136 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-be4823b9-930a-4104-a801-d32a8a0ff61c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:00.798116 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-be4823b9-930a-4104-a801-d32a8a0ff61c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.354071 Aug 10 23:17:00.799304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 153/311] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:00 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:01.031975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-fb5d9251-4892-4f8b-b7ed-db55f48088ba tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:01.040023 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-fb5d9251-4892-4f8b-b7ed-db55f48088ba tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1314 microversion: 2.1 time: 0.283758 Aug 10 23:17:01.040747 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 159/312] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:00 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:01.717088 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-019f7ee4-71b2-4b05-b3d8-18ccf3f929a2 req-2879f1fc-1cdb-448a-ae9f-936c79e12017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0", "tag": "463eea83-9a1e-4ef5-b192-8670ccb5d1c5"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:01.728818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-019f7ee4-71b2-4b05-b3d8-18ccf3f929a2 req-2879f1fc-1cdb-448a-ae9f-936c79e12017 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:01.729332 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-019f7ee4-71b2-4b05-b3d8-18ccf3f929a2 req-2879f1fc-1cdb-448a-ae9f-936c79e12017 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:01.729785 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-019f7ee4-71b2-4b05-b3d8-18ccf3f929a2 req-2879f1fc-1cdb-448a-ae9f-936c79e12017 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:01.741499 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-019f7ee4-71b2-4b05-b3d8-18ccf3f929a2 req-2879f1fc-1cdb-448a-ae9f-936c79e12017 service nova] Creating event network-changed:463eea83-9a1e-4ef5-b192-8670ccb5d1c5 for instance cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 on hv-cinder-85144 Aug 10 23:17:01.746371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-019f7ee4-71b2-4b05-b3d8-18ccf3f929a2 req-2879f1fc-1cdb-448a-ae9f-936c79e12017 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032951 Aug 10 23:17:01.747009 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 154/313] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:17:01.820624 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-372645fe-5edf-40eb-9d73-4a6ffb976102 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:01.821257 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-372645fe-5edf-40eb-9d73-4a6ffb976102 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:01.829546 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-372645fe-5edf-40eb-9d73-4a6ffb976102 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:01.830096 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-372645fe-5edf-40eb-9d73-4a6ffb976102 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:01.830533 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-372645fe-5edf-40eb-9d73-4a6ffb976102 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:01.831299 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-372645fe-5edf-40eb-9d73-4a6ffb976102 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:01.831757 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-372645fe-5edf-40eb-9d73-4a6ffb976102 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:01.832185 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-372645fe-5edf-40eb-9d73-4a6ffb976102 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.058565 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:02.062744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ef3faa4b-1fb7-4e55-a176-3d9e4295018d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:02.066777 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ef3faa4b-1fb7-4e55-a176-3d9e4295018d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:02.070408 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef3faa4b-1fb7-4e55-a176-3d9e4295018d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:02.070949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef3faa4b-1fb7-4e55-a176-3d9e4295018d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:02.071398 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef3faa4b-1fb7-4e55-a176-3d9e4295018d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.072269 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef3faa4b-1fb7-4e55-a176-3d9e4295018d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:02.072734 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef3faa4b-1fb7-4e55-a176-3d9e4295018d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:02.073215 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef3faa4b-1fb7-4e55-a176-3d9e4295018d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.224573 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-372645fe-5edf-40eb-9d73-4a6ffb976102 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:02.235139 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-372645fe-5edf-40eb-9d73-4a6ffb976102 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.418658 Aug 10 23:17:02.235731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 160/314] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:01 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:02.410397 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ef3faa4b-1fb7-4e55-a176-3d9e4295018d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:02.433690 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ef3faa4b-1fb7-4e55-a176-3d9e4295018d tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1314 microversion: 2.1 time: 0.364534 Aug 10 23:17:02.433690 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 155/315] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:02 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:02.502380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-66b373df-e318-4872-b6be-3733b4f18744 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:02.502898 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-66b373df-e318-4872-b6be-3733b4f18744 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:02.509263 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66b373df-e318-4872-b6be-3733b4f18744 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:02.509740 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66b373df-e318-4872-b6be-3733b4f18744 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:02.510170 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66b373df-e318-4872-b6be-3733b4f18744 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.511015 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66b373df-e318-4872-b6be-3733b4f18744 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:02.511468 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66b373df-e318-4872-b6be-3733b4f18744 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:02.511887 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66b373df-e318-4872-b6be-3733b4f18744 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.537163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-66b373df-e318-4872-b6be-3733b4f18744 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/ips" status: 200 len: 150 microversion: 2.1 time: 0.038650 Aug 10 23:17:02.537757 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 161/316] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 10 23:17:02 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:03.257575 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-06d7e301-00be-4ca4-b347-cf6bd652767b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:03.258186 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-06d7e301-00be-4ca4-b347-cf6bd652767b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:03.264448 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-06d7e301-00be-4ca4-b347-cf6bd652767b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:03.269779 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-06d7e301-00be-4ca4-b347-cf6bd652767b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:03.269779 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-06d7e301-00be-4ca4-b347-cf6bd652767b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:03.269779 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-06d7e301-00be-4ca4-b347-cf6bd652767b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:03.269779 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-06d7e301-00be-4ca4-b347-cf6bd652767b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:03.270164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-06d7e301-00be-4ca4-b347-cf6bd652767b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:03.395509 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-06d7e301-00be-4ca4-b347-cf6bd652767b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:03.403312 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-06d7e301-00be-4ca4-b347-cf6bd652767b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.149831 Aug 10 23:17:03.403945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 156/317] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:03 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:03.445385 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4915ff7e-962b-454e-a423-915b3d98526e tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:03.446001 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4915ff7e-962b-454e-a423-915b3d98526e tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:03.452007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4915ff7e-962b-454e-a423-915b3d98526e tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:03.452497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4915ff7e-962b-454e-a423-915b3d98526e tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:03.452928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4915ff7e-962b-454e-a423-915b3d98526e tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:03.453620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4915ff7e-962b-454e-a423-915b3d98526e tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:03.454073 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4915ff7e-962b-454e-a423-915b3d98526e tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:03.454497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4915ff7e-962b-454e-a423-915b3d98526e tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:03.580255 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4915ff7e-962b-454e-a423-915b3d98526e tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:03.588206 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4915ff7e-962b-454e-a423-915b3d98526e tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1314 microversion: 2.1 time: 0.146775 Aug 10 23:17:03.588776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 162/318] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:03 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:03.761457 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-4fbb8075-ad01-474e-b38e-ca5c61d0e3cd req-440bb193-78e9-4688-90a9-e15a6501464c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07f8d1d-7a4a-4398-b251-0020ad511eaa", "tag": "0374a737-979d-410d-a4d5-b23b238ed5d9"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:03.770919 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-4fbb8075-ad01-474e-b38e-ca5c61d0e3cd req-440bb193-78e9-4688-90a9-e15a6501464c service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:03.771881 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-4fbb8075-ad01-474e-b38e-ca5c61d0e3cd req-440bb193-78e9-4688-90a9-e15a6501464c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:03.772310 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-4fbb8075-ad01-474e-b38e-ca5c61d0e3cd req-440bb193-78e9-4688-90a9-e15a6501464c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:03.783033 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-4fbb8075-ad01-474e-b38e-ca5c61d0e3cd req-440bb193-78e9-4688-90a9-e15a6501464c service nova] Creating event network-changed:0374a737-979d-410d-a4d5-b23b238ed5d9 for instance b07f8d1d-7a4a-4398-b251-0020ad511eaa on hv-cinder-85144 Aug 10 23:17:03.788657 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-4fbb8075-ad01-474e-b38e-ca5c61d0e3cd req-440bb193-78e9-4688-90a9-e15a6501464c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030821 Aug 10 23:17:03.789213 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 157/319] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:04.248115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0bcf0d8f-26ce-4cd9-8def-0ed9d0e71283 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6277a744-367b-4da8-a2ca-836907c6866e"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:04.251310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0bcf0d8f-26ce-4cd9-8def-0ed9d0e71283 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:04.257974 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0bcf0d8f-26ce-4cd9-8def-0ed9d0e71283 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:04.258473 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0bcf0d8f-26ce-4cd9-8def-0ed9d0e71283 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:04.259051 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0bcf0d8f-26ce-4cd9-8def-0ed9d0e71283 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.259749 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0bcf0d8f-26ce-4cd9-8def-0ed9d0e71283 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:04.260204 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0bcf0d8f-26ce-4cd9-8def-0ed9d0e71283 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:04.260630 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0bcf0d8f-26ce-4cd9-8def-0ed9d0e71283 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.425572 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-86eea8e1-5ec2-43e5-aab9-7c6800b50b1f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:04.426606 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-86eea8e1-5ec2-43e5-aab9-7c6800b50b1f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:04.433234 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86eea8e1-5ec2-43e5-aab9-7c6800b50b1f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:04.433726 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86eea8e1-5ec2-43e5-aab9-7c6800b50b1f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:04.434169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86eea8e1-5ec2-43e5-aab9-7c6800b50b1f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.434902 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86eea8e1-5ec2-43e5-aab9-7c6800b50b1f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:04.435362 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86eea8e1-5ec2-43e5-aab9-7c6800b50b1f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:04.435827 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-86eea8e1-5ec2-43e5-aab9-7c6800b50b1f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.569092 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-86eea8e1-5ec2-43e5-aab9-7c6800b50b1f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:04.576545 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-86eea8e1-5ec2-43e5-aab9-7c6800b50b1f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.155754 Aug 10 23:17:04.577097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 158/320] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:04 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:04.609616 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-84374a72-0364-47fe-834e-db0e593f8d96 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:04.610223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-84374a72-0364-47fe-834e-db0e593f8d96 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:04.616185 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-84374a72-0364-47fe-834e-db0e593f8d96 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:04.616666 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-84374a72-0364-47fe-834e-db0e593f8d96 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:04.617107 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-84374a72-0364-47fe-834e-db0e593f8d96 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.617783 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-84374a72-0364-47fe-834e-db0e593f8d96 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:04.618230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-84374a72-0364-47fe-834e-db0e593f8d96 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:04.618650 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-84374a72-0364-47fe-834e-db0e593f8d96 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.745157 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-84374a72-0364-47fe-834e-db0e593f8d96 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:04.752419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-84374a72-0364-47fe-834e-db0e593f8d96 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1314 microversion: 2.1 time: 0.146678 Aug 10 23:17:04.752978 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 159/321] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:04 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:05.601927 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c482637f-e345-43ec-bbd2-fdc731605794 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:05.602595 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c482637f-e345-43ec-bbd2-fdc731605794 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:05.609452 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c482637f-e345-43ec-bbd2-fdc731605794 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.610079 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c482637f-e345-43ec-bbd2-fdc731605794 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.610531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c482637f-e345-43ec-bbd2-fdc731605794 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:05.611313 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c482637f-e345-43ec-bbd2-fdc731605794 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.611772 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c482637f-e345-43ec-bbd2-fdc731605794 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.612198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c482637f-e345-43ec-bbd2-fdc731605794 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:05.878975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:05.881977 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c482637f-e345-43ec-bbd2-fdc731605794 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:05.889470 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c482637f-e345-43ec-bbd2-fdc731605794 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.295974 Aug 10 23:17:05.890037 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 160/322] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:05 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:05.896297 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a31b9b2e-9c84-4fb9-9867-0c0145e4a3d3 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:05.897261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a31b9b2e-9c84-4fb9-9867-0c0145e4a3d3 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:05.900324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=10 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:05.902893 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a31b9b2e-9c84-4fb9-9867-0c0145e4a3d3 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.903380 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a31b9b2e-9c84-4fb9-9867-0c0145e4a3d3 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.907004 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a31b9b2e-9c84-4fb9-9867-0c0145e4a3d3 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:05.907004 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a31b9b2e-9c84-4fb9-9867-0c0145e4a3d3 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.907004 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a31b9b2e-9c84-4fb9-9867-0c0145e4a3d3 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.907004 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a31b9b2e-9c84-4fb9-9867-0c0145e4a3d3 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:06.035242 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a31b9b2e-9c84-4fb9-9867-0c0145e4a3d3 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:06.043414 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a31b9b2e-9c84-4fb9-9867-0c0145e4a3d3 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1314 microversion: 2.1 time: 0.152412 Aug 10 23:17:06.043988 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 161/323] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:05 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:06.298250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0bcf0d8f-26ce-4cd9-8def-0ed9d0e71283 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.053745 Aug 10 23:17:06.298862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 163/324] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:17:04 2022] POST /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-volume_attachments => generated 194 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:06.912866 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cdddce59-0587-4437-ac08-36e4367a83c5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:06.913511 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cdddce59-0587-4437-ac08-36e4367a83c5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:06.920086 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdddce59-0587-4437-ac08-36e4367a83c5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:06.920569 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdddce59-0587-4437-ac08-36e4367a83c5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:06.921003 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdddce59-0587-4437-ac08-36e4367a83c5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:06.921698 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdddce59-0587-4437-ac08-36e4367a83c5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:06.922147 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdddce59-0587-4437-ac08-36e4367a83c5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:06.922568 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdddce59-0587-4437-ac08-36e4367a83c5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:07.058786 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cdddce59-0587-4437-ac08-36e4367a83c5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:07.064361 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c5a8b2b5-c492-4048-ba0b-b258b750bdc6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:07.065214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c5a8b2b5-c492-4048-ba0b-b258b750bdc6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:07.069492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cdddce59-0587-4437-ac08-36e4367a83c5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.160911 Aug 10 23:17:07.070064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 162/325] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:06 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:07.073364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c5a8b2b5-c492-4048-ba0b-b258b750bdc6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:07.073364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c5a8b2b5-c492-4048-ba0b-b258b750bdc6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:07.073364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c5a8b2b5-c492-4048-ba0b-b258b750bdc6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:07.073958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c5a8b2b5-c492-4048-ba0b-b258b750bdc6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:07.074414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c5a8b2b5-c492-4048-ba0b-b258b750bdc6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:07.074911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c5a8b2b5-c492-4048-ba0b-b258b750bdc6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:07.172608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-518d7a98-cac8-4753-9410-c3215e4ebab0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:07.173201 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-518d7a98-cac8-4753-9410-c3215e4ebab0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:07.180179 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-518d7a98-cac8-4753-9410-c3215e4ebab0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:07.180752 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-518d7a98-cac8-4753-9410-c3215e4ebab0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:07.181285 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-518d7a98-cac8-4753-9410-c3215e4ebab0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:07.182066 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-518d7a98-cac8-4753-9410-c3215e4ebab0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:07.182645 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-518d7a98-cac8-4753-9410-c3215e4ebab0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:07.183170 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-518d7a98-cac8-4753-9410-c3215e4ebab0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:07.197688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=14 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:07.207422 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-518d7a98-cac8-4753-9410-c3215e4ebab0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/ips" status: 200 len: 151 microversion: 2.20 time: 0.042299 Aug 10 23:17:07.208034 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 163/326] 10.222.0.78 () {60 vars in 1289 bytes} [Wed Aug 10 23:17:07 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:17:07.220485 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c5a8b2b5-c492-4048-ba0b-b258b750bdc6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:07.229029 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c5a8b2b5-c492-4048-ba0b-b258b750bdc6 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1314 microversion: 2.1 time: 0.168820 Aug 10 23:17:07.233503 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 164/327] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:07 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:08.092673 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b8f4d7c8-1f82-4d32-9981-7fd41faf0599 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:08.093282 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b8f4d7c8-1f82-4d32-9981-7fd41faf0599 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:08.100848 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b8f4d7c8-1f82-4d32-9981-7fd41faf0599 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.101329 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b8f4d7c8-1f82-4d32-9981-7fd41faf0599 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.101765 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b8f4d7c8-1f82-4d32-9981-7fd41faf0599 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.102467 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b8f4d7c8-1f82-4d32-9981-7fd41faf0599 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.102954 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b8f4d7c8-1f82-4d32-9981-7fd41faf0599 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.103378 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b8f4d7c8-1f82-4d32-9981-7fd41faf0599 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.235832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b8f4d7c8-1f82-4d32-9981-7fd41faf0599 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:08.243487 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b8f4d7c8-1f82-4d32-9981-7fd41faf0599 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.155014 Aug 10 23:17:08.244053 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 164/328] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:08 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:08.252411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a33da34b-6fa2-4091-84a1-a2ff6e9e4976 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:08.253049 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a33da34b-6fa2-4091-84a1-a2ff6e9e4976 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:08.259700 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a33da34b-6fa2-4091-84a1-a2ff6e9e4976 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.260192 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a33da34b-6fa2-4091-84a1-a2ff6e9e4976 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.261222 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a33da34b-6fa2-4091-84a1-a2ff6e9e4976 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.261943 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a33da34b-6fa2-4091-84a1-a2ff6e9e4976 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.262408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a33da34b-6fa2-4091-84a1-a2ff6e9e4976 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.263431 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a33da34b-6fa2-4091-84a1-a2ff6e9e4976 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.404270 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a33da34b-6fa2-4091-84a1-a2ff6e9e4976 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:08.411748 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a33da34b-6fa2-4091-84a1-a2ff6e9e4976 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1314 microversion: 2.1 time: 0.163270 Aug 10 23:17:08.414179 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 165/329] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:08 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:09.264188 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fb5631de-a037-4fbe-830f-76a5d36227a0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:09.264807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-fb5631de-a037-4fbe-830f-76a5d36227a0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:09.271782 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb5631de-a037-4fbe-830f-76a5d36227a0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:09.272276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb5631de-a037-4fbe-830f-76a5d36227a0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:09.272717 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb5631de-a037-4fbe-830f-76a5d36227a0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:09.273547 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb5631de-a037-4fbe-830f-76a5d36227a0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:09.273983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb5631de-a037-4fbe-830f-76a5d36227a0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:09.274410 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb5631de-a037-4fbe-830f-76a5d36227a0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:09.408317 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-fb5631de-a037-4fbe-830f-76a5d36227a0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:09.416449 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-fb5631de-a037-4fbe-830f-76a5d36227a0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.156132 Aug 10 23:17:09.417039 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 165/330] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:09 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:09.433425 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3444373d-b638-4a42-aed6-534c3adfb578 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:09.436531 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3444373d-b638-4a42-aed6-534c3adfb578 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:09.440905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3444373d-b638-4a42-aed6-534c3adfb578 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:09.441391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3444373d-b638-4a42-aed6-534c3adfb578 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:09.441824 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3444373d-b638-4a42-aed6-534c3adfb578 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:09.442701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3444373d-b638-4a42-aed6-534c3adfb578 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:09.443166 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3444373d-b638-4a42-aed6-534c3adfb578 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:09.443612 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3444373d-b638-4a42-aed6-534c3adfb578 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:09.576646 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3444373d-b638-4a42-aed6-534c3adfb578 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:09.583999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3444373d-b638-4a42-aed6-534c3adfb578 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1314 microversion: 2.1 time: 0.153944 Aug 10 23:17:09.584558 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 166/331] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:09 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:10.437321 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6f1ee0d5-e567-419e-9705-f82103d36a9a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:10.437936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6f1ee0d5-e567-419e-9705-f82103d36a9a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:10.445011 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f1ee0d5-e567-419e-9705-f82103d36a9a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.445492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f1ee0d5-e567-419e-9705-f82103d36a9a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.446154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f1ee0d5-e567-419e-9705-f82103d36a9a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:10.446858 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f1ee0d5-e567-419e-9705-f82103d36a9a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.447403 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f1ee0d5-e567-419e-9705-f82103d36a9a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.447831 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f1ee0d5-e567-419e-9705-f82103d36a9a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:10.487098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0feafdae-1aa7-4d61-8bf7-c156834ed367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:10.487808 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0feafdae-1aa7-4d61-8bf7-c156834ed367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:10.495276 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feafdae-1aa7-4d61-8bf7-c156834ed367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.495912 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feafdae-1aa7-4d61-8bf7-c156834ed367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.496446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feafdae-1aa7-4d61-8bf7-c156834ed367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:10.497489 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feafdae-1aa7-4d61-8bf7-c156834ed367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.498162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feafdae-1aa7-4d61-8bf7-c156834ed367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.498997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feafdae-1aa7-4d61-8bf7-c156834ed367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:10.524509 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-0feafdae-1aa7-4d61-8bf7-c156834ed367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lazy-loading 'flavor' on Instance uuid d062824b-f7a6-4380-a622-5bba74816355 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:10.586924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6f1ee0d5-e567-419e-9705-f82103d36a9a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:10.595809 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6f1ee0d5-e567-419e-9705-f82103d36a9a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.162037 Aug 10 23:17:10.597083 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 166/332] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:10 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:10.602074 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-a887d92a-d546-4a1d-a969-4067f5c7a501 req-eb2ff66a-80a6-4636-9d79-04fcd7250a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07f8d1d-7a4a-4398-b251-0020ad511eaa", "name": "network-vif-plugged", "status": "completed", "tag": "0374a737-979d-410d-a4d5-b23b238ed5d9"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:10.611706 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a887d92a-d546-4a1d-a969-4067f5c7a501 req-eb2ff66a-80a6-4636-9d79-04fcd7250a92 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.614523 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a887d92a-d546-4a1d-a969-4067f5c7a501 req-eb2ff66a-80a6-4636-9d79-04fcd7250a92 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.614523 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a887d92a-d546-4a1d-a969-4067f5c7a501 req-eb2ff66a-80a6-4636-9d79-04fcd7250a92 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:10.623673 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-a887d92a-d546-4a1d-a969-4067f5c7a501 req-eb2ff66a-80a6-4636-9d79-04fcd7250a92 service nova] Creating event network-vif-plugged:0374a737-979d-410d-a4d5-b23b238ed5d9 for instance b07f8d1d-7a4a-4398-b251-0020ad511eaa on hv-cinder-85144 Aug 10 23:17:10.628834 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-a887d92a-d546-4a1d-a969-4067f5c7a501 req-eb2ff66a-80a6-4636-9d79-04fcd7250a92 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030486 Aug 10 23:17:10.629430 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 167/333] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:10.634862 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7c6488d4-da3e-4aef-8ace-ea0bcaa07e91 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:10.635549 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7c6488d4-da3e-4aef-8ace-ea0bcaa07e91 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:10.642061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7c6488d4-da3e-4aef-8ace-ea0bcaa07e91 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.642554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7c6488d4-da3e-4aef-8ace-ea0bcaa07e91 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.643050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7c6488d4-da3e-4aef-8ace-ea0bcaa07e91 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:10.643752 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7c6488d4-da3e-4aef-8ace-ea0bcaa07e91 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.644237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7c6488d4-da3e-4aef-8ace-ea0bcaa07e91 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.644665 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7c6488d4-da3e-4aef-8ace-ea0bcaa07e91 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:10.785178 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7c6488d4-da3e-4aef-8ace-ea0bcaa07e91 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:10.792807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7c6488d4-da3e-4aef-8ace-ea0bcaa07e91 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1314 microversion: 2.1 time: 0.162236 Aug 10 23:17:10.793382 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 168/334] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:10 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:11.047146 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0feafdae-1aa7-4d61-8bf7-c156834ed367 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "POST /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/action" status: 202 len: 0 microversion: 2.20 time: 0.564297 Aug 10 23:17:11.047746 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 167/335] 10.222.0.78 () {62 vars in 1319 bytes} [Wed Aug 10 23:17:10 2022] POST /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:17:11.056605 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:11.058907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:11.063513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:11.063998 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:11.064433 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:11.065272 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:11.065725 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:11.066149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:11.085516 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=100 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:11.204544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:11.213330 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:11.214876 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:11.216028 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7ae27d41-c949-409f-848c-4dc7659db8d3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.163934 Aug 10 23:17:11.216591 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 169/336] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:11 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:11.618414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d146a63c-200b-4e02-850b-97e04718132c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:11.619146 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d146a63c-200b-4e02-850b-97e04718132c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:11.626080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d146a63c-200b-4e02-850b-97e04718132c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:11.626550 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d146a63c-200b-4e02-850b-97e04718132c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:11.627018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d146a63c-200b-4e02-850b-97e04718132c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:11.627719 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d146a63c-200b-4e02-850b-97e04718132c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:11.628176 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d146a63c-200b-4e02-850b-97e04718132c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:11.628602 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d146a63c-200b-4e02-850b-97e04718132c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:11.632643 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:11.759424 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d146a63c-200b-4e02-850b-97e04718132c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:11.766850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d146a63c-200b-4e02-850b-97e04718132c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.153603 Aug 10 23:17:11.767456 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 168/337] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:11 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:11.813642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4c3aa0b3-e233-479f-b158-d7c2ae5f298a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:11.814252 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4c3aa0b3-e233-479f-b158-d7c2ae5f298a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:11.820712 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3aa0b3-e233-479f-b158-d7c2ae5f298a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:11.821264 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3aa0b3-e233-479f-b158-d7c2ae5f298a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:11.821705 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3aa0b3-e233-479f-b158-d7c2ae5f298a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:11.822396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3aa0b3-e233-479f-b158-d7c2ae5f298a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:11.822884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3aa0b3-e233-479f-b158-d7c2ae5f298a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:11.823312 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3aa0b3-e233-479f-b158-d7c2ae5f298a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:11.952011 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4c3aa0b3-e233-479f-b158-d7c2ae5f298a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:11.960024 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4c3aa0b3-e233-479f-b158-d7c2ae5f298a tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1314 microversion: 2.1 time: 0.150159 Aug 10 23:17:11.960521 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 170/338] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:11 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:12.239128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:12.242235 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:12.245875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.246366 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.246855 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.247561 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.248018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.248441 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.379414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:12.388128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:12.389643 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:12.390841 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-31c53ac8-5792-4be6-b852-f7a38990cf86 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.155591 Aug 10 23:17:12.391403 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 169/339] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:12 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:12.643750 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-74e13d0b-3f32-4790-92da-6e3969ba35af req-abbd484e-84eb-4e13-b202-ddd0690edcfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0", "name": "network-vif-plugged", "status": "completed", "tag": "463eea83-9a1e-4ef5-b192-8670ccb5d1c5"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:12.654062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-74e13d0b-3f32-4790-92da-6e3969ba35af req-abbd484e-84eb-4e13-b202-ddd0690edcfe service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.654533 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-74e13d0b-3f32-4790-92da-6e3969ba35af req-abbd484e-84eb-4e13-b202-ddd0690edcfe service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.654982 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-74e13d0b-3f32-4790-92da-6e3969ba35af req-abbd484e-84eb-4e13-b202-ddd0690edcfe service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.668283 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-74e13d0b-3f32-4790-92da-6e3969ba35af req-abbd484e-84eb-4e13-b202-ddd0690edcfe service nova] Creating event network-vif-plugged:463eea83-9a1e-4ef5-b192-8670ccb5d1c5 for instance cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 on hv-cinder-85144 Aug 10 23:17:12.673302 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-74e13d0b-3f32-4790-92da-6e3969ba35af req-abbd484e-84eb-4e13-b202-ddd0690edcfe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Aug 10 23:17:12.673878 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 171/340] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:12.788659 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c48be0c7-e42c-4a3b-9052-4e879732550b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:12.793465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c48be0c7-e42c-4a3b-9052-4e879732550b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:12.795715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c48be0c7-e42c-4a3b-9052-4e879732550b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.796199 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c48be0c7-e42c-4a3b-9052-4e879732550b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.796637 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c48be0c7-e42c-4a3b-9052-4e879732550b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.797334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c48be0c7-e42c-4a3b-9052-4e879732550b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.797787 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c48be0c7-e42c-4a3b-9052-4e879732550b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.798214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c48be0c7-e42c-4a3b-9052-4e879732550b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.928611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c48be0c7-e42c-4a3b-9052-4e879732550b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:12.936145 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c48be0c7-e42c-4a3b-9052-4e879732550b tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.152003 Aug 10 23:17:12.936708 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 170/341] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:12 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:12.981736 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-22d8a39b-8bf3-4b1f-b084-900eb9cd7920 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:12.982434 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-22d8a39b-8bf3-4b1f-b084-900eb9cd7920 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:12.989191 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-22d8a39b-8bf3-4b1f-b084-900eb9cd7920 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.989670 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-22d8a39b-8bf3-4b1f-b084-900eb9cd7920 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.990108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-22d8a39b-8bf3-4b1f-b084-900eb9cd7920 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.990844 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-22d8a39b-8bf3-4b1f-b084-900eb9cd7920 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.991299 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-22d8a39b-8bf3-4b1f-b084-900eb9cd7920 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.991724 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-22d8a39b-8bf3-4b1f-b084-900eb9cd7920 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:13.123101 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-22d8a39b-8bf3-4b1f-b084-900eb9cd7920 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:13.131078 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-22d8a39b-8bf3-4b1f-b084-900eb9cd7920 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1464 microversion: 2.1 time: 0.153949 Aug 10 23:17:13.131637 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 172/342] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:12 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:13.180483 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-42c5cb25-65b0-4888-830f-d057b1cfe0f4 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:13.180981 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-42c5cb25-65b0-4888-830f-d057b1cfe0f4 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:13.186918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42c5cb25-65b0-4888-830f-d057b1cfe0f4 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.187393 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42c5cb25-65b0-4888-830f-d057b1cfe0f4 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.187821 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42c5cb25-65b0-4888-830f-d057b1cfe0f4 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:13.188676 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42c5cb25-65b0-4888-830f-d057b1cfe0f4 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.189129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42c5cb25-65b0-4888-830f-d057b1cfe0f4 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.189550 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42c5cb25-65b0-4888-830f-d057b1cfe0f4 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:13.221415 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-42c5cb25-65b0-4888-830f-d057b1cfe0f4 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Going to try to terminate instance {{(pid=121333) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:17:13.414615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:13.415242 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:13.421347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.423805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.423805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:13.423805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.423805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.424152 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:13.499504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-42c5cb25-65b0-4888-830f-d057b1cfe0f4 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 204 len: 0 microversion: 2.1 time: 0.323140 Aug 10 23:17:13.500213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 171/343] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:17:13 2022] DELETE /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:17:13.509999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-99879191-6c71-4942-a66a-59cce22061ea tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:13.510739 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-99879191-6c71-4942-a66a-59cce22061ea tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:13.517461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99879191-6c71-4942-a66a-59cce22061ea tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.517955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99879191-6c71-4942-a66a-59cce22061ea tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.518390 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99879191-6c71-4942-a66a-59cce22061ea tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:13.519163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99879191-6c71-4942-a66a-59cce22061ea tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.519723 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99879191-6c71-4942-a66a-59cce22061ea tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.520080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99879191-6c71-4942-a66a-59cce22061ea tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:13.661944 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:13.669999 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:13.671476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:13.672640 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4539504f-f0db-48b9-be70-18bb073c1432 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.262056 Aug 10 23:17:13.686847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 173/344] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:13 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:13.691116 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-99879191-6c71-4942-a66a-59cce22061ea tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:13.699352 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-99879191-6c71-4942-a66a-59cce22061ea tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1470 microversion: 2.1 time: 0.194456 Aug 10 23:17:13.699922 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 172/345] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:13 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:13.957353 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-356198ba-dbc2-47a0-9a61-ff6f34f4cb6a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:13.957888 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-356198ba-dbc2-47a0-9a61-ff6f34f4cb6a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:13.963915 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-356198ba-dbc2-47a0-9a61-ff6f34f4cb6a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.964397 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-356198ba-dbc2-47a0-9a61-ff6f34f4cb6a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.964832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-356198ba-dbc2-47a0-9a61-ff6f34f4cb6a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:13.965527 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-356198ba-dbc2-47a0-9a61-ff6f34f4cb6a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.965984 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-356198ba-dbc2-47a0-9a61-ff6f34f4cb6a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.966412 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-356198ba-dbc2-47a0-9a61-ff6f34f4cb6a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:14.092615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-356198ba-dbc2-47a0-9a61-ff6f34f4cb6a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:14.100226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-356198ba-dbc2-47a0-9a61-ff6f34f4cb6a tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.147063 Aug 10 23:17:14.100789 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 174/346] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:13 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:14.695600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:14.696211 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:14.702684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:14.703173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:14.703604 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:14.704300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:14.704759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:14.705181 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:14.720926 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0fa717c7-c6c4-4671-90bf-cf0acbc46efe tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:14.721545 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0fa717c7-c6c4-4671-90bf-cf0acbc46efe tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:14.728059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fa717c7-c6c4-4671-90bf-cf0acbc46efe tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:14.728546 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fa717c7-c6c4-4671-90bf-cf0acbc46efe tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:14.728982 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fa717c7-c6c4-4671-90bf-cf0acbc46efe tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:14.729682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fa717c7-c6c4-4671-90bf-cf0acbc46efe tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:14.730140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fa717c7-c6c4-4671-90bf-cf0acbc46efe tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:14.730568 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fa717c7-c6c4-4671-90bf-cf0acbc46efe tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:14.891954 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:14.900588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:14.902109 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:14.903301 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6f12893a-afb0-462e-858d-1c0fab92a5b2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.211580 Aug 10 23:17:14.903864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 173/347] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:14 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:14.914041 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0fa717c7-c6c4-4671-90bf-cf0acbc46efe tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:14.921570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0fa717c7-c6c4-4671-90bf-cf0acbc46efe tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1470 microversion: 2.1 time: 0.204773 Aug 10 23:17:14.922123 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 175/348] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:14 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:15.120465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a41bf82a-0bcb-4410-ace2-4a8d46f5917f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:15.121082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a41bf82a-0bcb-4410-ace2-4a8d46f5917f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:15.127082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a41bf82a-0bcb-4410-ace2-4a8d46f5917f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:15.127567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a41bf82a-0bcb-4410-ace2-4a8d46f5917f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:15.128008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a41bf82a-0bcb-4410-ace2-4a8d46f5917f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:15.128702 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a41bf82a-0bcb-4410-ace2-4a8d46f5917f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:15.129162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a41bf82a-0bcb-4410-ace2-4a8d46f5917f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:15.129592 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a41bf82a-0bcb-4410-ace2-4a8d46f5917f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:15.266723 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a41bf82a-0bcb-4410-ace2-4a8d46f5917f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:15.274786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a41bf82a-0bcb-4410-ace2-4a8d46f5917f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.158112 Aug 10 23:17:15.275356 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 174/349] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:15 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:15.926789 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:15.928063 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:15.940928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:15.941412 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:15.941584 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-80003d5c-baf1-4edc-909e-6804433ead55 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:15.942015 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:15.942338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-80003d5c-baf1-4edc-909e-6804433ead55 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:15.942526 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:15.943040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:15.943514 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:15.948924 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80003d5c-baf1-4edc-909e-6804433ead55 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:15.949418 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80003d5c-baf1-4edc-909e-6804433ead55 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:15.949853 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80003d5c-baf1-4edc-909e-6804433ead55 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:15.950564 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80003d5c-baf1-4edc-909e-6804433ead55 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:15.951046 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80003d5c-baf1-4edc-909e-6804433ead55 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:15.951472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-80003d5c-baf1-4edc-909e-6804433ead55 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:16.140539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:16.144009 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-80003d5c-baf1-4edc-909e-6804433ead55 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:16.148610 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:16.150118 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:16.151300 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-aff23a43-523f-41da-834e-56ad2877472a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.228427 Aug 10 23:17:16.151725 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-80003d5c-baf1-4edc-909e-6804433ead55 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1470 microversion: 2.1 time: 0.214375 Aug 10 23:17:16.151844 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 176/350] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:15 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:16.152379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 175/351] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:15 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:16.300508 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5e59b23c-5c52-4c84-91af-0299cbff9ccf tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:16.301127 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5e59b23c-5c52-4c84-91af-0299cbff9ccf tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:16.309513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e59b23c-5c52-4c84-91af-0299cbff9ccf tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:16.310362 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e59b23c-5c52-4c84-91af-0299cbff9ccf tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:16.311165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e59b23c-5c52-4c84-91af-0299cbff9ccf tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:16.312411 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e59b23c-5c52-4c84-91af-0299cbff9ccf tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:16.313146 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e59b23c-5c52-4c84-91af-0299cbff9ccf tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:16.313828 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e59b23c-5c52-4c84-91af-0299cbff9ccf tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:16.444858 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5e59b23c-5c52-4c84-91af-0299cbff9ccf tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:16.452513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5e59b23c-5c52-4c84-91af-0299cbff9ccf tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1314 microversion: 2.1 time: 0.155843 Aug 10 23:17:16.453099 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 177/352] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:16 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:17.063027 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-69229064-34ce-4312-a3c1-d5416497cbf7 req-6d0d6fd7-18be-4385-af18-12339a4bc9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07f8d1d-7a4a-4398-b251-0020ad511eaa", "name": "network-vif-deleted", "tag": "0374a737-979d-410d-a4d5-b23b238ed5d9"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:17.073459 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-69229064-34ce-4312-a3c1-d5416497cbf7 req-6d0d6fd7-18be-4385-af18-12339a4bc9fc service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:17.074232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-69229064-34ce-4312-a3c1-d5416497cbf7 req-6d0d6fd7-18be-4385-af18-12339a4bc9fc service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:17.074682 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-69229064-34ce-4312-a3c1-d5416497cbf7 req-6d0d6fd7-18be-4385-af18-12339a4bc9fc service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.087902 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-69229064-34ce-4312-a3c1-d5416497cbf7 req-6d0d6fd7-18be-4385-af18-12339a4bc9fc service nova] Creating event network-vif-deleted:0374a737-979d-410d-a4d5-b23b238ed5d9 for instance b07f8d1d-7a4a-4398-b251-0020ad511eaa on hv-cinder-85144 Aug 10 23:17:17.092860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-69229064-34ce-4312-a3c1-d5416497cbf7 req-6d0d6fd7-18be-4385-af18-12339a4bc9fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033638 Aug 10 23:17:17.098540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 176/353] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:17.172999 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-65540885-fbb3-463d-8aaa-171e15beb925 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:17.173625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-65540885-fbb3-463d-8aaa-171e15beb925 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:17.175526 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:17.175526 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:17.180794 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65540885-fbb3-463d-8aaa-171e15beb925 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:17.181278 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65540885-fbb3-463d-8aaa-171e15beb925 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:17.181578 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:17.181724 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65540885-fbb3-463d-8aaa-171e15beb925 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.182069 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:17.182492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65540885-fbb3-463d-8aaa-171e15beb925 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:17.182607 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.182972 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65540885-fbb3-463d-8aaa-171e15beb925 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:17.183221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:17.183435 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65540885-fbb3-463d-8aaa-171e15beb925 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.183679 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:17.184108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.267652 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-65540885-fbb3-463d-8aaa-171e15beb925 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:17.275638 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-65540885-fbb3-463d-8aaa-171e15beb925 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1428 microversion: 2.1 time: 0.106519 Aug 10 23:17:17.276209 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 178/354] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:17 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:17.336528 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:17.344931 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:17.346563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:17.348642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8a53d53b-d601-4bac-b4e4-06a88b50683a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.177897 Aug 10 23:17:17.349718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 177/355] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:17 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:17.472316 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-05221581-06d7-4837-9707-057698d5e936 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:17.472928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-05221581-06d7-4837-9707-057698d5e936 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:17.478914 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05221581-06d7-4837-9707-057698d5e936 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:17.479401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05221581-06d7-4837-9707-057698d5e936 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:17.479850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05221581-06d7-4837-9707-057698d5e936 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.480562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05221581-06d7-4837-9707-057698d5e936 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:17.481016 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05221581-06d7-4837-9707-057698d5e936 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:17.481441 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05221581-06d7-4837-9707-057698d5e936 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.616247 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-05221581-06d7-4837-9707-057698d5e936 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:17.624956 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-05221581-06d7-4837-9707-057698d5e936 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1497 microversion: 2.1 time: 0.156816 Aug 10 23:17:17.625525 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 179/356] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:17 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:18.068295 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a49eea9f-e30d-4a41-8d37-6bc22ee5b626 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: .version_select at 0x7fe8407750d0>, body: {"keypair": {"name": "tempest-keypair-1457338765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyK7iFN6tu4EQWOWasOWgRbOsJKf4CJM2sUuPP5Vyx6Gpc3q2mU3Gnld1zhlI5na3ADCWgCs3JY3VIEo7VS0mpODstpgZwwtwxH8rziBMYpc0YrIwsjLueSjXFvpAIWaQ=="}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:18.085876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-a49eea9f-e30d-4a41-8d37-6bc22ee5b626 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'key_pairs'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:17:18.090331 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-a49eea9f-e30d-4a41-8d37-6bc22ee5b626 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for user 22e92975af1d439f88e33cc494c88b1f and project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'key_pairs'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:17:18.186359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a49eea9f-e30d-4a41-8d37-6bc22ee5b626 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121966 Aug 10 23:17:18.187016 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 178/357] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 10 23:17:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:18.296842 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:18.297455 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:18.304555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.305040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.305473 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.306203 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.306699 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.307148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.338429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.338965 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.339401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.339847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lazy-loading 'fault' on Instance uuid b07f8d1d-7a4a-4398-b251-0020ad511eaa {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:18.373072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:18.373691 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:18.381231 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.382082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.382588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.383336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.383799 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.384235 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.394450 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7de9e785544d14a901cd1c3e1d8bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea931246f8e74f6ab520b032fe2c5a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:18.402114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8740d5e6-70ea-456d-947d-20cb2fe8f708 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 200 len: 1304 microversion: 2.1 time: 0.109011 Aug 10 23:17:18.404949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 180/358] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:18 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:18.509599 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6843cb05-afc8-428c-be9e-8eac3e200ef1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:18.510363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6843cb05-afc8-428c-be9e-8eac3e200ef1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:18.516587 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6843cb05-afc8-428c-be9e-8eac3e200ef1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.517198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6843cb05-afc8-428c-be9e-8eac3e200ef1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.517744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6843cb05-afc8-428c-be9e-8eac3e200ef1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.518555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6843cb05-afc8-428c-be9e-8eac3e200ef1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.519052 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6843cb05-afc8-428c-be9e-8eac3e200ef1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.519488 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6843cb05-afc8-428c-be9e-8eac3e200ef1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.547831 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6843cb05-afc8-428c-be9e-8eac3e200ef1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:17:18.774930 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:18.804625 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:18.811923 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:18.814034 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:18.815230 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-aa130d12-c6f1-46f5-8615-44ca8f77a1d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.447020 Aug 10 23:17:18.816150 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 179/359] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:18 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:18.861179 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6843cb05-afc8-428c-be9e-8eac3e200ef1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 204 len: 0 microversion: 2.1 time: 0.355326 Aug 10 23:17:18.861764 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 181/360] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:17:18 2022] DELETE /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:17:18.869940 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b4124d6d-e359-4d0f-bb5c-6e5f6d22eaec tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:18.873424 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b4124d6d-e359-4d0f-bb5c-6e5f6d22eaec tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:18.876659 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b4124d6d-e359-4d0f-bb5c-6e5f6d22eaec tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.877133 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b4124d6d-e359-4d0f-bb5c-6e5f6d22eaec tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.877597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b4124d6d-e359-4d0f-bb5c-6e5f6d22eaec tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.878280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b4124d6d-e359-4d0f-bb5c-6e5f6d22eaec tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.878796 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b4124d6d-e359-4d0f-bb5c-6e5f6d22eaec tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.879356 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b4124d6d-e359-4d0f-bb5c-6e5f6d22eaec tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:19.006440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b4124d6d-e359-4d0f-bb5c-6e5f6d22eaec tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:19.013886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b4124d6d-e359-4d0f-bb5c-6e5f6d22eaec tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1503 microversion: 2.1 time: 0.147774 Aug 10 23:17:19.014465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 180/361] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:18 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:19.432868 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:19.433632 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] [instance: b07f8d1d-7a4a-4398-b251-0020ad511eaa] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:19.440176 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:19.440656 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:19.441135 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:19.441832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:19.442287 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:19.442738 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:19.456754 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] HTTP exception thrown: Instance b07f8d1d-7a4a-4398-b251-0020ad511eaa could not be found. Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Request method failure captured: Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa HTTP/1.1 Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DxhgJXwsKsfCjAk3biKzc0L3JT6GAuxQQeA1f1L_1pNvNLKmcZIPx5P_VYzW88PpQ0EUG6nJnyoDOwpKFYFwk2TBKWJUFGqP9NaCAzTiuh3m_gLIHkEBY3vSitVD_80yJqoBoQVVhbSPMPoeotvMZv2a73_z9_AGMzMXWlHszg-VUA Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: ea931246f8e74f6ab520b032fe2c5a3e Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-VolumesNegativeTest-1627467493 Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:17:19.458417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea931246f8e74f6ab520b032fe2c5a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea931246f8e74f6ab520b032fe2c5a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea931246f8e74f6ab520b032fe2c5a3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea931246f8e74f6ab520b032fe2c5a3e", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-VolumesNegativeTest-1627467493 Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: ea931246f8e74f6ab520b032fe2c5a3e Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-VolumesNegativeTest-1627467493 Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-VolumesNegativeTest-1627467493-project Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 4d7de9e785544d14a901cd1c3e1d8bd0 Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-VolumesNegativeTest-1627467493-project Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance b07f8d1d-7a4a-4398-b251-0020ad511eaa could not be found. Aug 10 23:17:19.460007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'b07f8d1d-7a4a-4398-b251-0020ad511eaa'} Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07f8d1d-7a4a-4398-b251-0020ad511eaa could not be found. Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:19.460951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07f8d1d-7a4a-4398-b251-0020ad511eaa could not be found. Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07f8d1d-7a4a-4398-b251-0020ad511eaa could not be found. Aug 10 23:17:19.462530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:17:19.463850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] Returning 404 to user: Instance b07f8d1d-7a4a-4398-b251-0020ad511eaa could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:19.463850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8b957f07-e851-4907-8a29-8f53a8227108 tempest-VolumesNegativeTest-1627467493 tempest-VolumesNegativeTest-1627467493-project] 10.222.0.78 "GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa" status: 404 len: 111 microversion: 2.1 time: 0.031523 Aug 10 23:17:19.463850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 182/362] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:19 2022] GET /compute/v2.1/servers/b07f8d1d-7a4a-4398-b251-0020ad511eaa => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:17:19.840003 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:19.840744 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:19.848198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:19.849621 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:19.850063 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:19.850817 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:19.851490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:19.852210 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:19.993437 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:20.001971 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:20.003526 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:20.004884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-fecf6e3f-42e1-4905-a866-fa19b6931388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.169975 Aug 10 23:17:20.018980 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 181/363] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:19 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:20.035161 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c5a26722-4331-43af-b66a-811a1ba5e8e0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:20.035769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c5a26722-4331-43af-b66a-811a1ba5e8e0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:20.042625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5a26722-4331-43af-b66a-811a1ba5e8e0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:20.043147 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5a26722-4331-43af-b66a-811a1ba5e8e0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:20.043582 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5a26722-4331-43af-b66a-811a1ba5e8e0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:20.044296 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5a26722-4331-43af-b66a-811a1ba5e8e0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:20.044750 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5a26722-4331-43af-b66a-811a1ba5e8e0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:20.045175 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5a26722-4331-43af-b66a-811a1ba5e8e0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:20.180983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c5a26722-4331-43af-b66a-811a1ba5e8e0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:20.188584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c5a26722-4331-43af-b66a-811a1ba5e8e0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1503 microversion: 2.1 time: 0.157293 Aug 10 23:17:20.189330 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 183/364] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:20 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:20.702804 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-989816345", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ce4c9a7-fd4e-4da4-add0-101e1cd65acd"}], "security_groups": [{"name": "tempest-securitygroup--2111487769"}], "key_name": "tempest-keypair-1457338765", "user_data": "}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:20.835880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] validate_networks() for [('5ce4c9a7-fd4e-4da4-add0-101e1cd65acd', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:17:21.027793 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.028397 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:21.034976 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.035465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.035905 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.037157 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.037611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.038037 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.378520 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:21.388800 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:21.390304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:21.391486 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-501e52d6-db14-43f2-8967-1c12829dffa3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.367776 Aug 10 23:17:21.392048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 184/365] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:21 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:21.397014 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-79134686-d6b0-4091-9b7f-0112816f45f5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.397618 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-79134686-d6b0-4091-9b7f-0112816f45f5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:21.403424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79134686-d6b0-4091-9b7f-0112816f45f5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.403905 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79134686-d6b0-4091-9b7f-0112816f45f5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.406740 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:17:21.407221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:17:21.407615 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:17:21.408019 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:17:21.408427 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:17:21.410554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79134686-d6b0-4091-9b7f-0112816f45f5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.411954 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:21.413468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79134686-d6b0-4091-9b7f-0112816f45f5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.413961 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79134686-d6b0-4091-9b7f-0112816f45f5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.415163 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79134686-d6b0-4091-9b7f-0112816f45f5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.418319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.418838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.428561 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.428561 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.428561 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.428561 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.438963 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:21.449007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:17:21.453025 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for user 22e92975af1d439f88e33cc494c88b1f and project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:17:21.464454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:17:21.466754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:17:21.486539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-79134686-d6b0-4091-9b7f-0112816f45f5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:21.494601 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-79134686-d6b0-4091-9b7f-0112816f45f5 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1461 microversion: 2.1 time: 0.101588 Aug 10 23:17:21.495474 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 185/366] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:21 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1461 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:21.500117 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-07df9e48-d551-4aa9-a5c8-43f60639d90e req-7e1e3817-fa39-47bf-b102-190a8bd2713f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0", "name": "network-vif-deleted", "tag": "463eea83-9a1e-4ef5-b192-8670ccb5d1c5"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:21.510183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-07df9e48-d551-4aa9-a5c8-43f60639d90e req-7e1e3817-fa39-47bf-b102-190a8bd2713f service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.510691 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-07df9e48-d551-4aa9-a5c8-43f60639d90e req-7e1e3817-fa39-47bf-b102-190a8bd2713f service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.511116 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-07df9e48-d551-4aa9-a5c8-43f60639d90e req-7e1e3817-fa39-47bf-b102-190a8bd2713f service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.522479 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-07df9e48-d551-4aa9-a5c8-43f60639d90e req-7e1e3817-fa39-47bf-b102-190a8bd2713f service nova] Creating event network-vif-deleted:463eea83-9a1e-4ef5-b192-8670ccb5d1c5 for instance cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 on hv-cinder-85144 Aug 10 23:17:21.527175 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-07df9e48-d551-4aa9-a5c8-43f60639d90e req-7e1e3817-fa39-47bf-b102-190a8bd2713f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030529 Aug 10 23:17:21.527749 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 186/367] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:21.609853 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-138f0e0c-b43c-44b2-87bd-9958997cd5cf tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.911338 Aug 10 23:17:21.610598 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 182/368] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:17:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:17:21.622796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a908713a-4028-4503-8ae7-ef8d14e24afa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.628172 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a908713a-4028-4503-8ae7-ef8d14e24afa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:21.681041 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a908713a-4028-4503-8ae7-ef8d14e24afa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:21.689108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a908713a-4028-4503-8ae7-ef8d14e24afa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1241 microversion: 2.1 time: 0.070643 Aug 10 23:17:21.689670 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 187/369] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:21 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:22.415910 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:22.416747 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:22.424738 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.425241 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.425672 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.426380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.427056 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.427322 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.517040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:22.517657 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:22.527612 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.528095 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.528530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.529229 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.529679 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.530099 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.564689 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.565398 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.565838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.566497 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lazy-loading 'fault' on Instance uuid cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:22.569244 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:22.582844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:22.585177 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:22.586468 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ce788c98-24c4-4ca9-bc44-973c98f53ff1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.175099 Aug 10 23:17:22.587259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 183/370] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:22 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:22.610449 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:22.619498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1bafa814-c2f5-4075-b26f-204d452a4a79 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 200 len: 1304 microversion: 2.1 time: 0.106569 Aug 10 23:17:22.620070 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 188/371] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:22 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:22.710200 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7ed68ce1-411e-4cdc-a5d4-b3e3d9e60d1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:22.710851 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7ed68ce1-411e-4cdc-a5d4-b3e3d9e60d1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:22.716792 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7ed68ce1-411e-4cdc-a5d4-b3e3d9e60d1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.717281 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7ed68ce1-411e-4cdc-a5d4-b3e3d9e60d1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.717720 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7ed68ce1-411e-4cdc-a5d4-b3e3d9e60d1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.718681 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7ed68ce1-411e-4cdc-a5d4-b3e3d9e60d1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.719156 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7ed68ce1-411e-4cdc-a5d4-b3e3d9e60d1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.719671 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7ed68ce1-411e-4cdc-a5d4-b3e3d9e60d1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.786757 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7ed68ce1-411e-4cdc-a5d4-b3e3d9e60d1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:22.794854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7ed68ce1-411e-4cdc-a5d4-b3e3d9e60d1b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1245 microversion: 2.1 time: 0.089351 Aug 10 23:17:22.795421 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 184/372] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:22 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:23.609019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:23.609625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:23.619433 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.619433 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.619433 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.619433 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.619804 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.619804 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.641072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:23.641987 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:23.649276 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.649771 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.650213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.651062 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.651523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.652232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.666610 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] HTTP exception thrown: Instance cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 could not be found. Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Request method failure captured: Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 HTTP/1.1 Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DxkrFA4Qbp7xyJIYs7MgYYmZHRxaEDSuXrIPQrNf3Pe04fwbJJ2qTWqRoB-qHZozpwoW0i_1YE1s9ILwZ8_eoGr8F1x3pWvxHpFcLMM88WF7_FWGnhKCP3IIs_F7NNQyoRtHwnpe8s9guO6SB8lWRRdtZ59F4ZRSCTLJYPa6qk1KuY Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 48dcf02947bd4522ac6886d8a0ca63ba Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-VolumesActionsTest-1683296671 Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:17:23.668446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48dcf02947bd4522ac6886d8a0ca63ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48dcf02947bd4522ac6886d8a0ca63ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48dcf02947bd4522ac6886d8a0ca63ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48dcf02947bd4522ac6886d8a0ca63ba", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-VolumesActionsTest-1683296671 Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 48dcf02947bd4522ac6886d8a0ca63ba Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-VolumesActionsTest-1683296671 Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-VolumesActionsTest-1683296671-project Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 50cf4af54ca0488ebb6bb0f7c33d6d58 Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-VolumesActionsTest-1683296671-project Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 could not be found. Aug 10 23:17:23.669786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0'} Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 could not be found. Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:23.670538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 could not be found. Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 could not be found. Aug 10 23:17:23.671826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:17:23.672960 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Returning 404 to user: Instance cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:23.672960 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6787c6a7-740f-4cb9-a355-772ab19d3a16 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0" status: 404 len: 111 microversion: 2.1 time: 0.033617 Aug 10 23:17:23.672960 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 185/373] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:23 2022] GET /compute/v2.1/servers/cb9d7ba6-2eca-44e6-ae4d-1db3d0547db0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:17:23.724460 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-683825298", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "networks": [{"uuid": "54dcd3e9-ed60-408a-8724-5d172a7753ab"}]}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:23.770283 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:23.780051 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:23.781566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:23.782993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-05d3f259-fbf3-43ed-9798-5545d36ef365 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1745 microversion: 2.20 time: 0.177741 Aug 10 23:17:23.783714 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 189/374] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:23 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:23.790974 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] validate_networks() for [('54dcd3e9-ed60-408a-8724-5d172a7753ab', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:17:23.814812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6f9a6d8d-06a9-41a2-881a-5fd12447c448 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:23.815440 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6f9a6d8d-06a9-41a2-881a-5fd12447c448 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:23.823255 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f9a6d8d-06a9-41a2-881a-5fd12447c448 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.823753 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f9a6d8d-06a9-41a2-881a-5fd12447c448 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.824334 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f9a6d8d-06a9-41a2-881a-5fd12447c448 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.825055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f9a6d8d-06a9-41a2-881a-5fd12447c448 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.825516 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f9a6d8d-06a9-41a2-881a-5fd12447c448 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.825947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6f9a6d8d-06a9-41a2-881a-5fd12447c448 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.902769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6f9a6d8d-06a9-41a2-881a-5fd12447c448 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:23.910556 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6f9a6d8d-06a9-41a2-881a-5fd12447c448 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1293 microversion: 2.1 time: 0.099676 Aug 10 23:17:23.911395 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 190/375] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:23 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:24.292446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:17:24.293755 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:17:24.294458 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:17:24.295120 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:17:24.295820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:17:24.321691 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:24.322387 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:24.322997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:24.323745 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:24.324212 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:24.324689 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:24.336280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:24.348066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Getting quotas for project 48dcf02947bd4522ac6886d8a0ca63ba. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:17:24.353033 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Getting quotas for user 50cf4af54ca0488ebb6bb0f7c33d6d58 and project 48dcf02947bd4522ac6886d8a0ca63ba. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:17:24.367879 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:17:24.370341 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:17:24.518912 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2d1bd40c-1706-473b-97f1-7fcf6040dd97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798469 Aug 10 23:17:24.519793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 186/376] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:17:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:17:24.531333 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-141d4658-220d-43a8-b671-85e47b697d62 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:24.532161 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-141d4658-220d-43a8-b671-85e47b697d62 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:24.607403 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-141d4658-220d-43a8-b671-85e47b697d62 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:24.617218 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-141d4658-220d-43a8-b671-85e47b697d62 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1213 microversion: 2.1 time: 0.090364 Aug 10 23:17:24.617950 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 191/377] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:24 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:24.813921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:24.814544 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:24.823013 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:24.823618 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:24.823943 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:24.824661 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:24.825118 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:24.825548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:24.935125 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ae701bcc-f0e9-400d-a2fe-ed4d96458f56 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:24.935734 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ae701bcc-f0e9-400d-a2fe-ed4d96458f56 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:24.942058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae701bcc-f0e9-400d-a2fe-ed4d96458f56 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:24.942541 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae701bcc-f0e9-400d-a2fe-ed4d96458f56 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:24.943002 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae701bcc-f0e9-400d-a2fe-ed4d96458f56 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:24.943696 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae701bcc-f0e9-400d-a2fe-ed4d96458f56 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:24.944141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae701bcc-f0e9-400d-a2fe-ed4d96458f56 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:24.944564 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae701bcc-f0e9-400d-a2fe-ed4d96458f56 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:25.028716 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ae701bcc-f0e9-400d-a2fe-ed4d96458f56 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:25.029737 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:25.032323 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ae701bcc-f0e9-400d-a2fe-ed4d96458f56 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1299 microversion: 2.1 time: 0.100965 Aug 10 23:17:25.032898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 192/378] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:24 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:25.041265 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:25.042882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:25.044201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b6972459-0879-43e1-8175-6e3f938a2989 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1745 microversion: 2.20 time: 0.234128 Aug 10 23:17:25.044820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 187/379] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:24 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1745 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:25.638228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8589419c-c998-4284-817c-30ff2aa62c25 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:25.641568 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8589419c-c998-4284-817c-30ff2aa62c25 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:25.693389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8589419c-c998-4284-817c-30ff2aa62c25 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:25.700030 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8589419c-c998-4284-817c-30ff2aa62c25 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1213 microversion: 2.1 time: 0.065777 Aug 10 23:17:25.700580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 193/380] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:25 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:26.005089 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-13c7dbd7-b3f4-4919-ada3-7c618f417048 req-4d1380f3-a955-485c-bb48-f47ea9e34f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574d9d8d-0e53-4ef2-a3b6-098699b20113", "tag": "435af46b-0cb5-4a55-a9a7-b8e22243257b"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:26.016100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-13c7dbd7-b3f4-4919-ada3-7c618f417048 req-4d1380f3-a955-485c-bb48-f47ea9e34f37 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.016587 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-13c7dbd7-b3f4-4919-ada3-7c618f417048 req-4d1380f3-a955-485c-bb48-f47ea9e34f37 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.017022 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-13c7dbd7-b3f4-4919-ada3-7c618f417048 req-4d1380f3-a955-485c-bb48-f47ea9e34f37 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.029662 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-13c7dbd7-b3f4-4919-ada3-7c618f417048 req-4d1380f3-a955-485c-bb48-f47ea9e34f37 service nova] Creating event network-changed:435af46b-0cb5-4a55-a9a7-b8e22243257b for instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 on hv-cinder-85144 Aug 10 23:17:26.034815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-13c7dbd7-b3f4-4919-ada3-7c618f417048 req-4d1380f3-a955-485c-bb48-f47ea9e34f37 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033374 Aug 10 23:17:26.035433 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 188/381] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:26.054434 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6b66646f-e8f1-4e18-bc41-84da0ed27612 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:26.055010 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6b66646f-e8f1-4e18-bc41-84da0ed27612 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:26.061736 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b66646f-e8f1-4e18-bc41-84da0ed27612 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.065273 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b66646f-e8f1-4e18-bc41-84da0ed27612 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.065273 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b66646f-e8f1-4e18-bc41-84da0ed27612 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.065273 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b66646f-e8f1-4e18-bc41-84da0ed27612 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.065273 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b66646f-e8f1-4e18-bc41-84da0ed27612 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.065648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b66646f-e8f1-4e18-bc41-84da0ed27612 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.070427 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:26.071301 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:26.077695 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.082582 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.082582 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.082582 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.082582 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.083395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.389906 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:26.396207 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6b66646f-e8f1-4e18-bc41-84da0ed27612 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:26.408507 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6b66646f-e8f1-4e18-bc41-84da0ed27612 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1367 microversion: 2.1 time: 0.358883 Aug 10 23:17:26.409031 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:26.409841 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 194/382] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:26 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:26.411211 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:26.412378 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b93e2f0b-b44b-40f1-87d5-f2e79de5a77f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1745 microversion: 2.20 time: 0.347595 Aug 10 23:17:26.414750 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 189/383] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:26 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1745 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:26.719858 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-90cee866-a11f-44f5-89fd-1dcc048d0ed0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:26.720550 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-90cee866-a11f-44f5-89fd-1dcc048d0ed0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:26.728154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-90cee866-a11f-44f5-89fd-1dcc048d0ed0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.728650 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-90cee866-a11f-44f5-89fd-1dcc048d0ed0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.729090 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-90cee866-a11f-44f5-89fd-1dcc048d0ed0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.732832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-90cee866-a11f-44f5-89fd-1dcc048d0ed0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.732832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-90cee866-a11f-44f5-89fd-1dcc048d0ed0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.732832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-90cee866-a11f-44f5-89fd-1dcc048d0ed0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.850382 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-90cee866-a11f-44f5-89fd-1dcc048d0ed0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:26.858426 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-90cee866-a11f-44f5-89fd-1dcc048d0ed0 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1265 microversion: 2.1 time: 0.142630 Aug 10 23:17:26.859067 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 195/384] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:26 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:27.431024 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-766e7181-2fe5-48b2-9b0b-40e05c2d4b8f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:27.437061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:27.437558 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:27.441081 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-766e7181-2fe5-48b2-9b0b-40e05c2d4b8f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:27.446899 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.447453 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-766e7181-2fe5-48b2-9b0b-40e05c2d4b8f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.447591 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.448034 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.448259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-766e7181-2fe5-48b2-9b0b-40e05c2d4b8f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.448743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.448859 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-766e7181-2fe5-48b2-9b0b-40e05c2d4b8f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.449201 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.449642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.449752 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-766e7181-2fe5-48b2-9b0b-40e05c2d4b8f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.450214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-766e7181-2fe5-48b2-9b0b-40e05c2d4b8f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.450879 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-766e7181-2fe5-48b2-9b0b-40e05c2d4b8f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.771149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:27.781577 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:27.783427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:27.784350 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f7da8e9d-71a4-4f1f-8462-226726bc7b81 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1745 microversion: 2.20 time: 0.351752 Aug 10 23:17:27.784907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 196/385] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:27 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1745 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:27.809387 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-766e7181-2fe5-48b2-9b0b-40e05c2d4b8f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:27.817533 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-766e7181-2fe5-48b2-9b0b-40e05c2d4b8f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1367 microversion: 2.1 time: 0.391904 Aug 10 23:17:27.818116 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 190/386] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:27 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:27.879097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-56b7e837-a94c-455a-ab8a-810bb8164c33 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:27.879718 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-56b7e837-a94c-455a-ab8a-810bb8164c33 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:27.886716 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-56b7e837-a94c-455a-ab8a-810bb8164c33 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.887212 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-56b7e837-a94c-455a-ab8a-810bb8164c33 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.887687 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-56b7e837-a94c-455a-ab8a-810bb8164c33 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.888395 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-56b7e837-a94c-455a-ab8a-810bb8164c33 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.888855 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-56b7e837-a94c-455a-ab8a-810bb8164c33 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.889286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-56b7e837-a94c-455a-ab8a-810bb8164c33 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.964241 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-56b7e837-a94c-455a-ab8a-810bb8164c33 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:27.971974 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-56b7e837-a94c-455a-ab8a-810bb8164c33 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1271 microversion: 2.1 time: 0.096719 Aug 10 23:17:27.972542 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 197/387] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:27 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:28.449917 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-579f1092-c26c-4810-a225-b7263a677b62 req-ea393375-e564-41a0-948a-516c25903ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d062824b-f7a6-4380-a622-5bba74816355", "name": "network-vif-plugged", "status": "completed", "tag": "6056ee81-d58a-4644-a5ae-8077d23b8e92"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:28.459895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-579f1092-c26c-4810-a225-b7263a677b62 req-ea393375-e564-41a0-948a-516c25903ba2 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.460381 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-579f1092-c26c-4810-a225-b7263a677b62 req-ea393375-e564-41a0-948a-516c25903ba2 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.460820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-579f1092-c26c-4810-a225-b7263a677b62 req-ea393375-e564-41a0-948a-516c25903ba2 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.471655 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-579f1092-c26c-4810-a225-b7263a677b62 req-ea393375-e564-41a0-948a-516c25903ba2 service nova] Creating event network-vif-plugged:6056ee81-d58a-4644-a5ae-8077d23b8e92 for instance d062824b-f7a6-4380-a622-5bba74816355 on hv-cinder-85144 Aug 10 23:17:28.476350 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-579f1092-c26c-4810-a225-b7263a677b62 req-ea393375-e564-41a0-948a-516c25903ba2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030121 Aug 10 23:17:28.476968 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 191/388] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:28.808829 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:28.809441 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:28.816218 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.816704 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.817149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.817875 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.818367 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.818840 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.839378 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-367cef6a-3eb6-4e05-9db5-c7979ed9c646 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:28.839988 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-367cef6a-3eb6-4e05-9db5-c7979ed9c646 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:28.846485 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-367cef6a-3eb6-4e05-9db5-c7979ed9c646 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.847004 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-367cef6a-3eb6-4e05-9db5-c7979ed9c646 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.847440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-367cef6a-3eb6-4e05-9db5-c7979ed9c646 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.848142 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-367cef6a-3eb6-4e05-9db5-c7979ed9c646 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.848601 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-367cef6a-3eb6-4e05-9db5-c7979ed9c646 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.849029 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-367cef6a-3eb6-4e05-9db5-c7979ed9c646 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:29.012674 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:29.020635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:29.022554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:29.023746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e217aa04-3e8c-4d85-8328-326f61b3fdb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1745 microversion: 2.20 time: 0.218897 Aug 10 23:17:29.023861 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-367cef6a-3eb6-4e05-9db5-c7979ed9c646 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:29.024305 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 198/389] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:28 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:29.029637 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-61c221ee-48ec-4147-99ce-5521064130b8 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:29.030376 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-61c221ee-48ec-4147-99ce-5521064130b8 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:29.031382 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-367cef6a-3eb6-4e05-9db5-c7979ed9c646 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1367 microversion: 2.1 time: 0.196452 Aug 10 23:17:29.032286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 192/390] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:28 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:29.039203 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-61c221ee-48ec-4147-99ce-5521064130b8 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:29.039789 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-61c221ee-48ec-4147-99ce-5521064130b8 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:29.040223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-61c221ee-48ec-4147-99ce-5521064130b8 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:29.040949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-61c221ee-48ec-4147-99ce-5521064130b8 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:29.041428 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-61c221ee-48ec-4147-99ce-5521064130b8 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:29.041849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-61c221ee-48ec-4147-99ce-5521064130b8 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:29.167308 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-61c221ee-48ec-4147-99ce-5521064130b8 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:29.174680 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-61c221ee-48ec-4147-99ce-5521064130b8 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1313 microversion: 2.1 time: 0.148558 Aug 10 23:17:29.175250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 199/391] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:29 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:30.047464 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:30.048083 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:30.051919 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-853472f4-2766-42a5-9999-f2757fcb9776 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:30.052526 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-853472f4-2766-42a5-9999-f2757fcb9776 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:30.055213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.055698 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.056129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.056834 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.057284 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.057709 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.059443 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-853472f4-2766-42a5-9999-f2757fcb9776 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.059919 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-853472f4-2766-42a5-9999-f2757fcb9776 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.060351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-853472f4-2766-42a5-9999-f2757fcb9776 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.061038 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-853472f4-2766-42a5-9999-f2757fcb9776 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.061491 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-853472f4-2766-42a5-9999-f2757fcb9776 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.061918 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-853472f4-2766-42a5-9999-f2757fcb9776 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.249420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:30.256301 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-853472f4-2766-42a5-9999-f2757fcb9776 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:30.257700 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:30.259521 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:30.260693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-761ac3ea-f194-4b47-9ade-56aa45cc4388 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1745 microversion: 2.20 time: 0.217288 Aug 10 23:17:30.261259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 193/392] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:30 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:30.265734 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-853472f4-2766-42a5-9999-f2757fcb9776 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1367 microversion: 2.1 time: 0.217591 Aug 10 23:17:30.265888 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-68ccd803-c4b1-41ef-be3f-c732859ae57c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:30.278694 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 200/393] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:30 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:30.278870 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-68ccd803-c4b1-41ef-be3f-c732859ae57c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:30.278870 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-68ccd803-c4b1-41ef-be3f-c732859ae57c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.278870 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-68ccd803-c4b1-41ef-be3f-c732859ae57c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.278870 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-68ccd803-c4b1-41ef-be3f-c732859ae57c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.279250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-68ccd803-c4b1-41ef-be3f-c732859ae57c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.279250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-68ccd803-c4b1-41ef-be3f-c732859ae57c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.279250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-68ccd803-c4b1-41ef-be3f-c732859ae57c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.406503 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-68ccd803-c4b1-41ef-be3f-c732859ae57c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:30.414559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-68ccd803-c4b1-41ef-be3f-c732859ae57c tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1313 microversion: 2.1 time: 0.152117 Aug 10 23:17:30.415095 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 194/394] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:30 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:31.136153 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-04f0e01e-92b0-419f-b154-b486434ff12a req-231ebe53-0a2a-497f-9a24-a96d2ea07985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38ce75fa-f384-4492-a5bd-850f896a9685", "tag": "1e645691-bacb-42f9-b18f-28440fdfc31a"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:31.146203 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-04f0e01e-92b0-419f-b154-b486434ff12a req-231ebe53-0a2a-497f-9a24-a96d2ea07985 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.147293 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-04f0e01e-92b0-419f-b154-b486434ff12a req-231ebe53-0a2a-497f-9a24-a96d2ea07985 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.147732 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-04f0e01e-92b0-419f-b154-b486434ff12a req-231ebe53-0a2a-497f-9a24-a96d2ea07985 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.158875 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-04f0e01e-92b0-419f-b154-b486434ff12a req-231ebe53-0a2a-497f-9a24-a96d2ea07985 service nova] Creating event network-changed:1e645691-bacb-42f9-b18f-28440fdfc31a for instance 38ce75fa-f384-4492-a5bd-850f896a9685 on hv-cinder-85144 Aug 10 23:17:31.164485 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-04f0e01e-92b0-419f-b154-b486434ff12a req-231ebe53-0a2a-497f-9a24-a96d2ea07985 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031960 Aug 10 23:17:31.165094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 201/395] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:17:31.283502 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:31.284730 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:31.287148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-405bdf62-1c53-48de-9f74-eca84915e955 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:31.287861 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-405bdf62-1c53-48de-9f74-eca84915e955 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:31.291541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.292213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.292645 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.293417 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.294028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.294326 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-405bdf62-1c53-48de-9f74-eca84915e955 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.294611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.294855 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-405bdf62-1c53-48de-9f74-eca84915e955 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.295295 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-405bdf62-1c53-48de-9f74-eca84915e955 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.296298 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-405bdf62-1c53-48de-9f74-eca84915e955 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.296879 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-405bdf62-1c53-48de-9f74-eca84915e955 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.297318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-405bdf62-1c53-48de-9f74-eca84915e955 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.515326 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:31.525421 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:31.527579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:31.528849 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a9204304-b768-4537-a653-487f0a4199c0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1745 microversion: 2.20 time: 0.249205 Aug 10 23:17:31.529416 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 195/396] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:31 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1745 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:31.541253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-405bdf62-1c53-48de-9f74-eca84915e955 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:31.546209 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-36b27988-8893-48dc-96a8-1f348c6535d2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:31.546209 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-36b27988-8893-48dc-96a8-1f348c6535d2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:31.549835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-36b27988-8893-48dc-96a8-1f348c6535d2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.550328 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-36b27988-8893-48dc-96a8-1f348c6535d2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.550561 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-405bdf62-1c53-48de-9f74-eca84915e955 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1367 microversion: 2.1 time: 0.267662 Aug 10 23:17:31.550834 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-36b27988-8893-48dc-96a8-1f348c6535d2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.551384 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 202/397] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:31 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:31.552197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-36b27988-8893-48dc-96a8-1f348c6535d2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.553513 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-36b27988-8893-48dc-96a8-1f348c6535d2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.553957 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-36b27988-8893-48dc-96a8-1f348c6535d2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.709692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-36b27988-8893-48dc-96a8-1f348c6535d2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:31.717555 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-36b27988-8893-48dc-96a8-1f348c6535d2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1313 microversion: 2.1 time: 0.186986 Aug 10 23:17:31.718139 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 196/398] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:31 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:32.553373 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:32.553999 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:32.560491 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:32.560913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:32.561350 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:32.562043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:32.562494 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:32.562946 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:32.573197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6b4b06bf-c16d-4a6f-9d6b-8396a09361e0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:32.574452 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6b4b06bf-c16d-4a6f-9d6b-8396a09361e0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:32.583135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b4b06bf-c16d-4a6f-9d6b-8396a09361e0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:32.583899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b4b06bf-c16d-4a6f-9d6b-8396a09361e0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:32.584511 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b4b06bf-c16d-4a6f-9d6b-8396a09361e0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:32.585851 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b4b06bf-c16d-4a6f-9d6b-8396a09361e0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:32.586475 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b4b06bf-c16d-4a6f-9d6b-8396a09361e0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:32.587095 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6b4b06bf-c16d-4a6f-9d6b-8396a09361e0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:32.761398 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:32.769562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:32.771786 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:32.776645 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0b1af09e-0809-42f0-bd18-24517f28d055 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.224174 Aug 10 23:17:32.776645 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 203/399] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:32 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:32.776976 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6b4b06bf-c16d-4a6f-9d6b-8396a09361e0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:32.778072 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-71894800-31d1-4924-8234-8767be084e97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:32.778693 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-71894800-31d1-4924-8234-8767be084e97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:32.784645 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71894800-31d1-4924-8234-8767be084e97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:32.785069 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6b4b06bf-c16d-4a6f-9d6b-8396a09361e0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1367 microversion: 2.1 time: 0.215794 Aug 10 23:17:32.785192 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71894800-31d1-4924-8234-8767be084e97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:32.785548 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71894800-31d1-4924-8234-8767be084e97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:32.791888 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 197/400] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:32 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:32.792061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71894800-31d1-4924-8234-8767be084e97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:32.792061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71894800-31d1-4924-8234-8767be084e97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:32.792061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-71894800-31d1-4924-8234-8767be084e97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:32.955289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-71894800-31d1-4924-8234-8767be084e97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:32.963942 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-71894800-31d1-4924-8234-8767be084e97 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1313 microversion: 2.1 time: 0.189392 Aug 10 23:17:32.978007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 204/401] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:32 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:33.798257 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:33.799065 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:33.806589 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c3b2baef-5fea-4bea-a64e-e7df60663a50 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:33.807240 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c3b2baef-5fea-4bea-a64e-e7df60663a50 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:33.813567 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3b2baef-5fea-4bea-a64e-e7df60663a50 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:33.819327 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:33.819822 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:33.820290 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:33.821218 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:33.821450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:33.821879 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:33.826263 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3b2baef-5fea-4bea-a64e-e7df60663a50 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:33.826737 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3b2baef-5fea-4bea-a64e-e7df60663a50 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:33.827485 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3b2baef-5fea-4bea-a64e-e7df60663a50 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:33.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3b2baef-5fea-4bea-a64e-e7df60663a50 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:33.828371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3b2baef-5fea-4bea-a64e-e7df60663a50 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:34.052208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:34.061923 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:34.063678 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:34.064868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-cab6578c-79bd-4ac1-967e-ce19f2ca7387 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.271404 Aug 10 23:17:34.078683 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 198/402] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:33 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:34.078683 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d36bee0e-29c2-4aa9-bbf5-62df3cd6f750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:34.078683 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d36bee0e-29c2-4aa9-bbf5-62df3cd6f750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:34.078683 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d36bee0e-29c2-4aa9-bbf5-62df3cd6f750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:34.078683 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d36bee0e-29c2-4aa9-bbf5-62df3cd6f750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:34.097069 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d36bee0e-29c2-4aa9-bbf5-62df3cd6f750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:34.097069 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d36bee0e-29c2-4aa9-bbf5-62df3cd6f750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:34.097069 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d36bee0e-29c2-4aa9-bbf5-62df3cd6f750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:34.097069 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d36bee0e-29c2-4aa9-bbf5-62df3cd6f750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:34.097555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c3b2baef-5fea-4bea-a64e-e7df60663a50 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:34.097555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c3b2baef-5fea-4bea-a64e-e7df60663a50 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1367 microversion: 2.1 time: 0.293716 Aug 10 23:17:34.099869 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 205/403] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:33 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:34.234434 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d36bee0e-29c2-4aa9-bbf5-62df3cd6f750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:34.243414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d36bee0e-29c2-4aa9-bbf5-62df3cd6f750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1313 microversion: 2.1 time: 0.176524 Aug 10 23:17:34.244145 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 199/404] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:34 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:34.963623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-49aa06c2-45cc-4cf9-86b7-6afa1c19398b req-34c44f8a-feae-4a41-af11-65e070719f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574d9d8d-0e53-4ef2-a3b6-098699b20113", "name": "network-vif-plugged", "status": "completed", "tag": "435af46b-0cb5-4a55-a9a7-b8e22243257b"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:34.979091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-49aa06c2-45cc-4cf9-86b7-6afa1c19398b req-34c44f8a-feae-4a41-af11-65e070719f92 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:34.979885 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-49aa06c2-45cc-4cf9-86b7-6afa1c19398b req-34c44f8a-feae-4a41-af11-65e070719f92 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:34.980568 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-49aa06c2-45cc-4cf9-86b7-6afa1c19398b req-34c44f8a-feae-4a41-af11-65e070719f92 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:34.997951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=100 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:35.000436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-49aa06c2-45cc-4cf9-86b7-6afa1c19398b req-34c44f8a-feae-4a41-af11-65e070719f92 service nova] Creating event network-vif-plugged:435af46b-0cb5-4a55-a9a7-b8e22243257b for instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 on hv-cinder-85144 Aug 10 23:17:35.006697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-49aa06c2-45cc-4cf9-86b7-6afa1c19398b req-34c44f8a-feae-4a41-af11-65e070719f92 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046581 Aug 10 23:17:35.007888 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 206/405] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:35.092831 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:35.093809 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:35.096143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=4 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:35.096873 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=16 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:35.101936 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:35.109718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:35.109718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:35.109718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:35.109718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:35.110374 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:35.128945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a0ce80b0-b0eb-4059-9aff-6f94bbd52e44 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:35.130393 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a0ce80b0-b0eb-4059-9aff-6f94bbd52e44 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:35.148983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a0ce80b0-b0eb-4059-9aff-6f94bbd52e44 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:35.149952 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a0ce80b0-b0eb-4059-9aff-6f94bbd52e44 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:35.150644 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a0ce80b0-b0eb-4059-9aff-6f94bbd52e44 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:35.151764 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a0ce80b0-b0eb-4059-9aff-6f94bbd52e44 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:35.152381 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a0ce80b0-b0eb-4059-9aff-6f94bbd52e44 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:35.153016 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a0ce80b0-b0eb-4059-9aff-6f94bbd52e44 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:35.393676 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:35.402830 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:35.404351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:35.404491 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a0ce80b0-b0eb-4059-9aff-6f94bbd52e44 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:35.409562 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-cf931709-f165-4fbd-848a-da1f2683a81a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.320360 Aug 10 23:17:35.415082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 200/406] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:35 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:35.415448 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a0ce80b0-b0eb-4059-9aff-6f94bbd52e44 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1367 microversion: 2.1 time: 0.288710 Aug 10 23:17:35.415448 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 207/407] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:35 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:35.416093 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-48a2d6c3-0481-4c78-806d-a8ef5772c9ea tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:35.416713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-48a2d6c3-0481-4c78-806d-a8ef5772c9ea tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:35.423760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-48a2d6c3-0481-4c78-806d-a8ef5772c9ea tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:35.424288 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-48a2d6c3-0481-4c78-806d-a8ef5772c9ea tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:35.424725 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-48a2d6c3-0481-4c78-806d-a8ef5772c9ea tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:35.425433 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-48a2d6c3-0481-4c78-806d-a8ef5772c9ea tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:35.425882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-48a2d6c3-0481-4c78-806d-a8ef5772c9ea tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:35.426303 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-48a2d6c3-0481-4c78-806d-a8ef5772c9ea tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:35.587718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-48a2d6c3-0481-4c78-806d-a8ef5772c9ea tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:35.591161 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-48a2d6c3-0481-4c78-806d-a8ef5772c9ea tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1313 microversion: 2.1 time: 0.179601 Aug 10 23:17:35.591747 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 201/408] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:35 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:36.460002 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8e3991d4-69d6-4144-a9ba-684c46d1c131 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:36.460002 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8e3991d4-69d6-4144-a9ba-684c46d1c131 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:36.460002 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=6 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:36.460692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:36.460692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:36.461225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8e3991d4-69d6-4144-a9ba-684c46d1c131 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:36.461225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8e3991d4-69d6-4144-a9ba-684c46d1c131 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:36.461225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8e3991d4-69d6-4144-a9ba-684c46d1c131 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:36.461225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8e3991d4-69d6-4144-a9ba-684c46d1c131 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:36.461520 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8e3991d4-69d6-4144-a9ba-684c46d1c131 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:36.461520 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8e3991d4-69d6-4144-a9ba-684c46d1c131 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:36.461667 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:36.461667 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:36.461667 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:36.461667 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:36.461956 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:36.461956 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:36.769038 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8e3991d4-69d6-4144-a9ba-684c46d1c131 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:36.784100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8e3991d4-69d6-4144-a9ba-684c46d1c131 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1367 microversion: 2.1 time: 0.353013 Aug 10 23:17:36.785810 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 208/409] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:36 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:36.792672 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f41f141e-c820-4a3d-9e8f-88c46101aa2f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:36.793574 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f41f141e-c820-4a3d-9e8f-88c46101aa2f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:36.801585 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41f141e-c820-4a3d-9e8f-88c46101aa2f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:36.801745 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:36.802988 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41f141e-c820-4a3d-9e8f-88c46101aa2f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:36.803728 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41f141e-c820-4a3d-9e8f-88c46101aa2f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:36.805514 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41f141e-c820-4a3d-9e8f-88c46101aa2f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:36.806350 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41f141e-c820-4a3d-9e8f-88c46101aa2f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:36.807300 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41f141e-c820-4a3d-9e8f-88c46101aa2f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:36.815618 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:36.815618 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:36.815618 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c7293362-425a-4e34-8704-5740687fa54f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.378283 Aug 10 23:17:36.816519 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 202/410] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:36 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:36.972883 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f41f141e-c820-4a3d-9e8f-88c46101aa2f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:36.981357 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f41f141e-c820-4a3d-9e8f-88c46101aa2f tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1313 microversion: 2.1 time: 0.193871 Aug 10 23:17:36.982368 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 209/411] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:36 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:37.806645 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-757d66bf-8af8-4473-b517-63a23afbde08 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:37.807290 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-757d66bf-8af8-4473-b517-63a23afbde08 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:37.816223 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-757d66bf-8af8-4473-b517-63a23afbde08 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:37.816727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-757d66bf-8af8-4473-b517-63a23afbde08 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:37.817172 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-757d66bf-8af8-4473-b517-63a23afbde08 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:37.818574 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-757d66bf-8af8-4473-b517-63a23afbde08 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:37.819402 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-757d66bf-8af8-4473-b517-63a23afbde08 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:37.819758 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-757d66bf-8af8-4473-b517-63a23afbde08 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:37.844292 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:37.846798 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:37.856948 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:37.857920 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:37.859160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:37.860475 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:37.861043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:37.861588 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:38.113174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-757d66bf-8af8-4473-b517-63a23afbde08 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:38.123162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-757d66bf-8af8-4473-b517-63a23afbde08 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1557 microversion: 2.1 time: 0.321075 Aug 10 23:17:38.124535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 203/412] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:37 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1557 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:38.133292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b920e7f3-2ad6-477b-9c37-79a62fd305fc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:38.134057 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b920e7f3-2ad6-477b-9c37-79a62fd305fc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:38.142371 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b920e7f3-2ad6-477b-9c37-79a62fd305fc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:38.143025 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b920e7f3-2ad6-477b-9c37-79a62fd305fc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:38.143563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b920e7f3-2ad6-477b-9c37-79a62fd305fc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:38.144709 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b920e7f3-2ad6-477b-9c37-79a62fd305fc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:38.145359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b920e7f3-2ad6-477b-9c37-79a62fd305fc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:38.146475 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b920e7f3-2ad6-477b-9c37-79a62fd305fc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:38.179359 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:38.188416 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:38.192521 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:38.206518 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cb2885ed-b418-4706-8880-698d1e2ff5b9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.354519 Aug 10 23:17:38.207805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 210/413] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:37 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:38.216674 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f013a9df-96d2-4b0b-9930-d83312c611a6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:38.218483 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f013a9df-96d2-4b0b-9930-d83312c611a6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:38.229796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f013a9df-96d2-4b0b-9930-d83312c611a6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:38.235517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f013a9df-96d2-4b0b-9930-d83312c611a6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:38.235517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f013a9df-96d2-4b0b-9930-d83312c611a6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:38.235517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f013a9df-96d2-4b0b-9930-d83312c611a6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:38.235517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f013a9df-96d2-4b0b-9930-d83312c611a6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:38.235986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f013a9df-96d2-4b0b-9930-d83312c611a6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:38.396512 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f013a9df-96d2-4b0b-9930-d83312c611a6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187460 Aug 10 23:17:38.397470 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 211/414] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 10 23:17:38 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:38.443696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b920e7f3-2ad6-477b-9c37-79a62fd305fc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:38.448878 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=100 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:38.453827 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b920e7f3-2ad6-477b-9c37-79a62fd305fc tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1313 microversion: 2.1 time: 0.327394 Aug 10 23:17:38.454383 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 204/415] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:38 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:38.953301 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-c05e3cca-06d9-4e5e-af58-8db1811133b6 req-763dda9a-8d8b-4a8a-95b1-d216845a0b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ce75fa-f384-4492-a5bd-850f896a9685", "name": "network-vif-plugged", "status": "completed", "tag": "1e645691-bacb-42f9-b18f-28440fdfc31a"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:38.966128 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-c05e3cca-06d9-4e5e-af58-8db1811133b6 req-763dda9a-8d8b-4a8a-95b1-d216845a0b6c service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:38.967102 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-c05e3cca-06d9-4e5e-af58-8db1811133b6 req-763dda9a-8d8b-4a8a-95b1-d216845a0b6c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:38.967842 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-c05e3cca-06d9-4e5e-af58-8db1811133b6 req-763dda9a-8d8b-4a8a-95b1-d216845a0b6c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:38.980484 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-c05e3cca-06d9-4e5e-af58-8db1811133b6 req-763dda9a-8d8b-4a8a-95b1-d216845a0b6c service nova] Creating event network-vif-plugged:1e645691-bacb-42f9-b18f-28440fdfc31a for instance 38ce75fa-f384-4492-a5bd-850f896a9685 on hv-cinder-85144 Aug 10 23:17:38.985365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-c05e3cca-06d9-4e5e-af58-8db1811133b6 req-763dda9a-8d8b-4a8a-95b1-d216845a0b6c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037046 Aug 10 23:17:38.985991 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 212/416] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:39.220604 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:39.221202 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:39.228217 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:39.228695 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:39.229122 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:39.229809 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:39.230255 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:39.230701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:39.375004 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:39.383557 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:39.385074 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:39.386229 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8cde3f8f-52b7-4e23-bba4-4b29ef97b55d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.169868 Aug 10 23:17:39.386815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 205/417] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:39 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:39.483543 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a40271c9-31b8-41ab-80c9-91267212b750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:39.484756 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a40271c9-31b8-41ab-80c9-91267212b750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:39.492756 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40271c9-31b8-41ab-80c9-91267212b750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:39.493713 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40271c9-31b8-41ab-80c9-91267212b750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:39.494491 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40271c9-31b8-41ab-80c9-91267212b750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:39.496432 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40271c9-31b8-41ab-80c9-91267212b750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:39.497141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40271c9-31b8-41ab-80c9-91267212b750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:39.497780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40271c9-31b8-41ab-80c9-91267212b750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:40.060272 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a40271c9-31b8-41ab-80c9-91267212b750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:40.070484 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a40271c9-31b8-41ab-80c9-91267212b750 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1313 microversion: 2.1 time: 0.596405 Aug 10 23:17:40.085074 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 213/418] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:39 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:40.320396 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-54ec7772-be7a-428b-9ddf-c8112a36c10d req-3f398706-d6e8-4d5c-b5fc-514a4b62417e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574d9d8d-0e53-4ef2-a3b6-098699b20113", "tag": "435af46b-0cb5-4a55-a9a7-b8e22243257b"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:40.333049 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-54ec7772-be7a-428b-9ddf-c8112a36c10d req-3f398706-d6e8-4d5c-b5fc-514a4b62417e service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:40.334075 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-54ec7772-be7a-428b-9ddf-c8112a36c10d req-3f398706-d6e8-4d5c-b5fc-514a4b62417e service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:40.334572 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-54ec7772-be7a-428b-9ddf-c8112a36c10d req-3f398706-d6e8-4d5c-b5fc-514a4b62417e service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:40.347057 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-54ec7772-be7a-428b-9ddf-c8112a36c10d req-3f398706-d6e8-4d5c-b5fc-514a4b62417e service nova] Creating event network-changed:435af46b-0cb5-4a55-a9a7-b8e22243257b for instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 on hv-cinder-85144 Aug 10 23:17:40.353034 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-54ec7772-be7a-428b-9ddf-c8112a36c10d req-3f398706-d6e8-4d5c-b5fc-514a4b62417e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036277 Aug 10 23:17:40.353850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 206/419] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:40.412827 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:40.413823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:40.425076 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:40.425911 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:40.426570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:40.429779 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:40.430331 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:40.431176 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:40.673553 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:40.683434 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:40.685974 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:40.687975 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f7be4601-4a14-4af8-a35a-0933cc5ea6e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.281443 Aug 10 23:17:40.689424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 214/420] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:40 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:41.092933 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9e6eca9d-e25a-408b-a765-c588b4a8af30 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:41.094143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9e6eca9d-e25a-408b-a765-c588b4a8af30 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:41.101801 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9e6eca9d-e25a-408b-a765-c588b4a8af30 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:41.102837 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9e6eca9d-e25a-408b-a765-c588b4a8af30 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:41.103517 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9e6eca9d-e25a-408b-a765-c588b4a8af30 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:41.104474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9e6eca9d-e25a-408b-a765-c588b4a8af30 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:41.105160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9e6eca9d-e25a-408b-a765-c588b4a8af30 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:41.105800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9e6eca9d-e25a-408b-a765-c588b4a8af30 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:41.418775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9e6eca9d-e25a-408b-a765-c588b4a8af30 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:41.438118 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9e6eca9d-e25a-408b-a765-c588b4a8af30 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1313 microversion: 2.1 time: 0.349539 Aug 10 23:17:41.441334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 207/421] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:41 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:41.720056 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:41.720996 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:41.735426 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:41.735926 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:41.736365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:41.738472 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:41.738964 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:41.739399 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:41.929249 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:41.940428 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:41.946767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:41.946767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ba3ac2e4-08b7-4d2d-a462-555371142312 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.232185 Aug 10 23:17:41.946767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 215/422] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:41 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:42.465082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-62fbf7b7-b5ed-4b97-bf16-0d33f0cf3ecd tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:42.465731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-62fbf7b7-b5ed-4b97-bf16-0d33f0cf3ecd tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:42.472856 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62fbf7b7-b5ed-4b97-bf16-0d33f0cf3ecd tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:42.473391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62fbf7b7-b5ed-4b97-bf16-0d33f0cf3ecd tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:42.474886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62fbf7b7-b5ed-4b97-bf16-0d33f0cf3ecd tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:42.475932 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62fbf7b7-b5ed-4b97-bf16-0d33f0cf3ecd tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:42.476569 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62fbf7b7-b5ed-4b97-bf16-0d33f0cf3ecd tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:42.476725 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62fbf7b7-b5ed-4b97-bf16-0d33f0cf3ecd tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:42.651544 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-62fbf7b7-b5ed-4b97-bf16-0d33f0cf3ecd tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:42.659263 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-62fbf7b7-b5ed-4b97-bf16-0d33f0cf3ecd tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1496 microversion: 2.1 time: 0.198148 Aug 10 23:17:42.659832 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 208/423] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:42 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1496 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:42.967068 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:42.967743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:42.975125 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:42.975605 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:42.976037 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:42.976719 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:42.977164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:42.977581 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:43.105074 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:43.113195 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:43.114727 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:43.116600 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6a33920e-2af2-408d-835c-585d05686bff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.153437 Aug 10 23:17:43.117005 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 216/424] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:42 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:43.833096 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-22a4a925-f93e-4748-a1e9-861ac4162cb9 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:43.834251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-22a4a925-f93e-4748-a1e9-861ac4162cb9 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:43.840998 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22a4a925-f93e-4748-a1e9-861ac4162cb9 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:43.841567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22a4a925-f93e-4748-a1e9-861ac4162cb9 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:43.842081 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22a4a925-f93e-4748-a1e9-861ac4162cb9 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:43.842903 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22a4a925-f93e-4748-a1e9-861ac4162cb9 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:43.843699 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22a4a925-f93e-4748-a1e9-861ac4162cb9 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:43.844364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22a4a925-f93e-4748-a1e9-861ac4162cb9 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:43.875194 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-22a4a925-f93e-4748-a1e9-861ac4162cb9 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Going to try to terminate instance {{(pid=121333) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:17:44.138844 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:44.139456 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:44.146097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:44.146846 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:44.147188 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:44.147892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:44.148344 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:44.148772 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:44.283530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:44.292044 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:44.293537 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:44.294698 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0320758f-2144-4a3f-8f5e-aa84fab869b0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.159954 Aug 10 23:17:44.295255 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 217/425] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:44 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:44.299130 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-22a4a925-f93e-4748-a1e9-861ac4162cb9 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "DELETE /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 204 len: 0 microversion: 2.1 time: 0.469715 Aug 10 23:17:44.299831 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 209/426] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:17:43 2022] DELETE /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:17:44.311067 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5cf98c2c-b031-4799-88fc-1e51fd29da43 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:44.311672 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5cf98c2c-b031-4799-88fc-1e51fd29da43 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:44.317639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cf98c2c-b031-4799-88fc-1e51fd29da43 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:44.318176 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cf98c2c-b031-4799-88fc-1e51fd29da43 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:44.318610 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cf98c2c-b031-4799-88fc-1e51fd29da43 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:44.319347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cf98c2c-b031-4799-88fc-1e51fd29da43 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:44.319796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cf98c2c-b031-4799-88fc-1e51fd29da43 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:44.320241 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cf98c2c-b031-4799-88fc-1e51fd29da43 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:44.455282 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5cf98c2c-b031-4799-88fc-1e51fd29da43 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:44.462800 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5cf98c2c-b031-4799-88fc-1e51fd29da43 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1502 microversion: 2.1 time: 0.155427 Aug 10 23:17:44.463369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 218/427] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:44 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:45.319146 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:45.319969 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:45.326433 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:45.326951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:45.327391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:45.328089 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:45.328547 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:45.328975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:45.460614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:45.468815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:45.470326 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:45.471506 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-280624f3-7b69-4727-a7ff-f9bdb1fff0c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1740 microversion: 2.20 time: 0.157329 Aug 10 23:17:45.472064 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 210/428] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:45 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:45.483824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ff09031c-6477-4162-a146-74c26105e9f1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:45.484458 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ff09031c-6477-4162-a146-74c26105e9f1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:45.491482 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ff09031c-6477-4162-a146-74c26105e9f1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:45.491955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ff09031c-6477-4162-a146-74c26105e9f1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:45.492383 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ff09031c-6477-4162-a146-74c26105e9f1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:45.493076 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ff09031c-6477-4162-a146-74c26105e9f1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:45.493522 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ff09031c-6477-4162-a146-74c26105e9f1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:45.493937 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ff09031c-6477-4162-a146-74c26105e9f1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:45.635521 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ff09031c-6477-4162-a146-74c26105e9f1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:45.642882 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ff09031c-6477-4162-a146-74c26105e9f1 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1502 microversion: 2.1 time: 0.162853 Aug 10 23:17:45.643443 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 219/429] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:45 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:46.495002 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:46.495616 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:46.502330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:46.502852 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:46.503313 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:46.504017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:46.504470 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:46.504898 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:46.666150 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-18499262-2d44-4a3f-936d-fc9c1eebc44e tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:46.667208 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-18499262-2d44-4a3f-936d-fc9c1eebc44e tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:46.674572 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-18499262-2d44-4a3f-936d-fc9c1eebc44e tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:46.675251 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-18499262-2d44-4a3f-936d-fc9c1eebc44e tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:46.675826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-18499262-2d44-4a3f-936d-fc9c1eebc44e tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:46.676928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-18499262-2d44-4a3f-936d-fc9c1eebc44e tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:46.677526 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-18499262-2d44-4a3f-936d-fc9c1eebc44e tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:46.678086 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-18499262-2d44-4a3f-936d-fc9c1eebc44e tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:46.876447 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:46.885440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:46.887013 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:46.888162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f3bd7f92-c5e1-4242-b62a-8a32d853523b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1722 microversion: 2.20 time: 0.397365 Aug 10 23:17:46.888720 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 211/430] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:46 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:47.003304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-18499262-2d44-4a3f-936d-fc9c1eebc44e tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:47.011030 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-18499262-2d44-4a3f-936d-fc9c1eebc44e tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1502 microversion: 2.1 time: 0.349774 Aug 10 23:17:47.011606 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 220/431] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:46 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1502 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:47.469958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-8a388e86-7211-460a-b6cd-f57eb4ee4fca req-2dc09992-034e-4cd0-9eb3-478f83fdd9eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ce75fa-f384-4492-a5bd-850f896a9685", "name": "network-vif-deleted", "tag": "1e645691-bacb-42f9-b18f-28440fdfc31a"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:47.480586 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-8a388e86-7211-460a-b6cd-f57eb4ee4fca req-2dc09992-034e-4cd0-9eb3-478f83fdd9eb service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:47.481068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-8a388e86-7211-460a-b6cd-f57eb4ee4fca req-2dc09992-034e-4cd0-9eb3-478f83fdd9eb service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:47.481504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-8a388e86-7211-460a-b6cd-f57eb4ee4fca req-2dc09992-034e-4cd0-9eb3-478f83fdd9eb service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:47.492682 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-8a388e86-7211-460a-b6cd-f57eb4ee4fca req-2dc09992-034e-4cd0-9eb3-478f83fdd9eb service nova] Creating event network-vif-deleted:1e645691-bacb-42f9-b18f-28440fdfc31a for instance 38ce75fa-f384-4492-a5bd-850f896a9685 on hv-cinder-85144 Aug 10 23:17:47.497468 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-8a388e86-7211-460a-b6cd-f57eb4ee4fca req-2dc09992-034e-4cd0-9eb3-478f83fdd9eb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031493 Aug 10 23:17:47.498066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 212/432] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:47.911514 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:47.912061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:47.918968 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:47.919452 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:47.919926 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:47.920711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:47.921173 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:47.921676 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:48.033096 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e6168451-b9fc-4cf1-8eac-d1564cdc6bc2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:48.034018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e6168451-b9fc-4cf1-8eac-d1564cdc6bc2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:48.040812 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6168451-b9fc-4cf1-8eac-d1564cdc6bc2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:48.041296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6168451-b9fc-4cf1-8eac-d1564cdc6bc2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:48.041733 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6168451-b9fc-4cf1-8eac-d1564cdc6bc2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:48.042437 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6168451-b9fc-4cf1-8eac-d1564cdc6bc2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:48.042922 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6168451-b9fc-4cf1-8eac-d1564cdc6bc2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:48.043350 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6168451-b9fc-4cf1-8eac-d1564cdc6bc2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:48.049826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:48.057722 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:48.059291 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:48.060433 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b6f017d1-36d3-44b4-bcaa-d7d66c4e2913 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1722 microversion: 2.20 time: 0.152889 Aug 10 23:17:48.060987 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 221/433] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:47 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:48.105648 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e6168451-b9fc-4cf1-8eac-d1564cdc6bc2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:48.113006 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e6168451-b9fc-4cf1-8eac-d1564cdc6bc2 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1460 microversion: 2.1 time: 0.084571 Aug 10 23:17:48.113566 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 213/434] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:48 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1460 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:49.083060 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:49.083675 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:49.090365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:49.090898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:49.091340 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:49.092045 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:49.092502 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:49.092938 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:49.133845 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c8687562-eadd-4173-b657-0e6cdddaa273 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:49.134441 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c8687562-eadd-4173-b657-0e6cdddaa273 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:49.140934 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c8687562-eadd-4173-b657-0e6cdddaa273 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:49.141415 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c8687562-eadd-4173-b657-0e6cdddaa273 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:49.141845 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c8687562-eadd-4173-b657-0e6cdddaa273 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:49.142563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c8687562-eadd-4173-b657-0e6cdddaa273 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:49.143024 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c8687562-eadd-4173-b657-0e6cdddaa273 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:49.143450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c8687562-eadd-4173-b657-0e6cdddaa273 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:49.231178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c8687562-eadd-4173-b657-0e6cdddaa273 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf4af54ca0488ebb6bb0f7c33d6d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dcf02947bd4522ac6886d8a0ca63ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:49.238824 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c8687562-eadd-4173-b657-0e6cdddaa273 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 200 len: 1298 microversion: 2.1 time: 0.109338 Aug 10 23:17:49.239534 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 214/435] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:49 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:49.260489 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:49.268414 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:49.269913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:49.271094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c62ad986-92eb-4477-9781-5bf97717dc3b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1722 microversion: 2.20 time: 0.192006 Aug 10 23:17:49.271643 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 222/436] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:49 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:50.259963 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:50.260598 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] [instance: 38ce75fa-f384-4492-a5bd-850f896a9685] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:50.267159 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:50.272991 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:50.272991 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:50.272991 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:50.272991 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:50.273386 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:50.284707 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] HTTP exception thrown: Instance 38ce75fa-f384-4492-a5bd-850f896a9685 could not be found. Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Request method failure captured: Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 HTTP/1.1 Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DxkrFA4Qbp7xyJIYs7MgYYmZHRxaEDSuXrIPQrNf3Pe04fwbJJ2qTWqRoB-qHZozpwoW0i_1YE1s9ILwZ8_eoGr8F1x3pWvxHpFcLMM88WF7_FWGnhKCP3IIs_F7NNQyoRtHwnpe8s9guO6SB8lWRRdtZ59F4ZRSCTLJYPa6qk1KuY Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 48dcf02947bd4522ac6886d8a0ca63ba Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-VolumesActionsTest-1683296671 Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:17:50.286353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48dcf02947bd4522ac6886d8a0ca63ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48dcf02947bd4522ac6886d8a0ca63ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48dcf02947bd4522ac6886d8a0ca63ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48dcf02947bd4522ac6886d8a0ca63ba", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-VolumesActionsTest-1683296671 Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 48dcf02947bd4522ac6886d8a0ca63ba Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-VolumesActionsTest-1683296671 Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-VolumesActionsTest-1683296671-project Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 50cf4af54ca0488ebb6bb0f7c33d6d58 Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-VolumesActionsTest-1683296671-project Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance 38ce75fa-f384-4492-a5bd-850f896a9685 could not be found. Aug 10 23:17:50.287763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '38ce75fa-f384-4492-a5bd-850f896a9685'} Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38ce75fa-f384-4492-a5bd-850f896a9685 could not be found. Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:50.288567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38ce75fa-f384-4492-a5bd-850f896a9685 could not be found. Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38ce75fa-f384-4492-a5bd-850f896a9685 could not be found. Aug 10 23:17:50.289835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:17:50.292915 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] Returning 404 to user: Instance 38ce75fa-f384-4492-a5bd-850f896a9685 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:50.292915 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-44057ffb-9cc4-4251-8574-19af759b4a74 tempest-VolumesActionsTest-1683296671 tempest-VolumesActionsTest-1683296671-project] 10.222.0.78 "GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685" status: 404 len: 111 microversion: 2.1 time: 0.032227 Aug 10 23:17:50.293812 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 215/437] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:50 2022] GET /compute/v2.1/servers/38ce75fa-f384-4492-a5bd-850f896a9685 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:17:50.293971 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:50.293971 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:50.297634 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=92 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:50.301247 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:50.302102 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:50.302627 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:50.307588 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:50.307588 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:50.307588 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:50.440142 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:50.451456 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:50.453342 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:50.459967 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-524a3421-554d-41a0-b8e5-515a207ad9f6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1665 microversion: 2.20 time: 0.170479 Aug 10 23:17:50.465711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 223/438] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:50 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:50.483287 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2d097697-5cbb-46eb-8bd1-2726142b4eb5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf8ea20a-a413-414b-8637-3c45fcf77592"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:50.485574 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2d097697-5cbb-46eb-8bd1-2726142b4eb5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:50.488878 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:50.492740 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d097697-5cbb-46eb-8bd1-2726142b4eb5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:50.493224 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d097697-5cbb-46eb-8bd1-2726142b4eb5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:50.493663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d097697-5cbb-46eb-8bd1-2726142b4eb5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:50.494368 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d097697-5cbb-46eb-8bd1-2726142b4eb5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:50.494856 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d097697-5cbb-46eb-8bd1-2726142b4eb5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:50.495290 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2d097697-5cbb-46eb-8bd1-2726142b4eb5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:50.754921 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-5c7c2e82-82fb-4d26-a0c5-eadacca679a2 req-2d259afb-416d-40eb-a129-57b624ead3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d062824b-f7a6-4380-a622-5bba74816355", "name": "network-vif-unplugged", "status": "completed", "tag": "6056ee81-d58a-4644-a5ae-8077d23b8e92"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:50.764861 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-5c7c2e82-82fb-4d26-a0c5-eadacca679a2 req-2d259afb-416d-40eb-a129-57b624ead3a5 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:50.765346 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-5c7c2e82-82fb-4d26-a0c5-eadacca679a2 req-2d259afb-416d-40eb-a129-57b624ead3a5 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:50.765958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-5c7c2e82-82fb-4d26-a0c5-eadacca679a2 req-2d259afb-416d-40eb-a129-57b624ead3a5 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:50.776798 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.compute.server_external_events [req-5c7c2e82-82fb-4d26-a0c5-eadacca679a2 req-2d259afb-416d-40eb-a129-57b624ead3a5 service nova] Unable to find a host for instance d062824b-f7a6-4380-a622-5bba74816355. Dropping event network-vif-unplugged {{(pid=121332) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 23:17:50.777654 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-5c7c2e82-82fb-4d26-a0c5-eadacca679a2 req-2d259afb-416d-40eb-a129-57b624ead3a5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026659 Aug 10 23:17:50.778217 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 224/439] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 23:17:51.841611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2d097697-5cbb-46eb-8bd1-2726142b4eb5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "POST /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.362124 Aug 10 23:17:51.842220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 216/440] 10.222.0.78 () {62 vars in 1364 bytes} [Wed Aug 10 23:17:50 2022] POST /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-volume_attachments => generated 188 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:17:51.964220 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d642dde8-0f3e-4023-8c5a-069dfd368282 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:51.970206 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d642dde8-0f3e-4023-8c5a-069dfd368282 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:51.971776 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d642dde8-0f3e-4023-8c5a-069dfd368282 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:51.972257 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d642dde8-0f3e-4023-8c5a-069dfd368282 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:51.972693 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d642dde8-0f3e-4023-8c5a-069dfd368282 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:51.973385 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d642dde8-0f3e-4023-8c5a-069dfd368282 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:51.973835 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d642dde8-0f3e-4023-8c5a-069dfd368282 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:51.974258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d642dde8-0f3e-4023-8c5a-069dfd368282 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:51.978542 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=100 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:52.015569 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d642dde8-0f3e-4023-8c5a-069dfd368282 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121332) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 10 23:17:52.312465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d642dde8-0f3e-4023-8c5a-069dfd368282 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "POST /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/action" status: 202 len: 0 microversion: 2.20 time: 0.352527 Aug 10 23:17:52.313089 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 225/441] 10.222.0.78 () {62 vars in 1319 bytes} [Wed Aug 10 23:17:51 2022] POST /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:17:52.322254 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:52.323025 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:52.330575 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:52.335389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:52.335389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:52.335389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:52.335389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:52.335772 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:52.467529 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:52.476367 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:52.477941 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:52.479204 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8381d3c7-2db9-44d3-8672-febfc47637a7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1751 microversion: 2.20 time: 0.161618 Aug 10 23:17:52.479758 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 217/442] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:52 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:53.501961 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:53.502553 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:53.508740 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:53.509225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:53.509664 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:53.510365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:53.510851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:53.511282 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:53.644588 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:53.653746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:53.655045 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:53.656373 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6639cbe1-70f1-4c9d-8c8a-9f5b34558eab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1751 microversion: 2.20 time: 0.158772 Aug 10 23:17:53.656723 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 226/443] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:53 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:54.680023 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:54.680641 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:54.687129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:54.687611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:54.688047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:54.688737 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:54.689188 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:54.689614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:54.822573 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:54.831353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:54.832840 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:54.833975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d9ead97c-204c-4139-8459-cb869c1866d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1753 microversion: 2.20 time: 0.158005 Aug 10 23:17:54.834525 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 218/444] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:54 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:55.857169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:55.857817 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:55.864285 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:55.869287 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:55.869287 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:55.869287 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:55.869287 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:55.869837 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:55.995666 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:56.004057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:56.005496 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:56.007198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-fc1a0a4d-91ed-4d93-8f57-ea91b3527191 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1753 microversion: 2.20 time: 0.153298 Aug 10 23:17:56.007759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 227/445] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:55 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:57.030502 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:57.031160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:57.038680 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:57.039255 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:57.039604 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:57.040319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:57.040775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:57.041210 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:57.045406 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:57.178318 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:57.187317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:57.189215 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:57.190390 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ed368a5c-5c5a-4c7a-8110-e0f5dc22f4b6 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1753 microversion: 2.20 time: 0.163856 Aug 10 23:17:57.191012 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 219/446] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:57 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:58.213770 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:58.214419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:58.221775 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:58.222266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:58.222723 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:58.223624 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:58.224230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:58.224805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:58.533050 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6e938703-335a-4bc5-94ca-6272cb19d68c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "660d91c8-9ea6-4e69-b0ca-0e33893af524"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:58.542376 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:58.543181 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6e938703-335a-4bc5-94ca-6272cb19d68c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:58.555526 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:58.557706 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:58.559951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e938703-335a-4bc5-94ca-6272cb19d68c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:58.561227 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-74aa9dd0-4334-41b2-8601-73b2b6f6943f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.351920 Aug 10 23:17:58.563372 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 228/447] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:58 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:58.564760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e938703-335a-4bc5-94ca-6272cb19d68c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:58.565610 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e938703-335a-4bc5-94ca-6272cb19d68c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:58.566920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e938703-335a-4bc5-94ca-6272cb19d68c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:58.567969 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e938703-335a-4bc5-94ca-6272cb19d68c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:58.569507 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e938703-335a-4bc5-94ca-6272cb19d68c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:59.605862 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:59.607887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:59.619790 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:59.620805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:59.621645 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:59.622644 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:59.632791 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:59.634465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:59.716881 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6e938703-335a-4bc5-94ca-6272cb19d68c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.176197 Aug 10 23:17:59.741675 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 220/448] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:17:58 2022] POST /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments => generated 194 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:59.992181 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:00.002069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:00.003797 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:00.005361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a46022cd-93f3-437e-a3b6-efd511ee98d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.404942 Aug 10 23:18:00.007055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 229/449] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:59 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:01.034300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:01.035830 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:01.045752 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:01.046333 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:01.047008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:01.047713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:01.048166 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:01.048756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:01.203913 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:01.213951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:01.215857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:01.218293 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d253ca1f-1480-4e51-9e80-94b526de0be8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.188113 Aug 10 23:18:01.219951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 221/450] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:01 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:02.242930 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:02.243647 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:02.250758 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:02.251689 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:02.252361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:02.253316 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:02.254124 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:02.254835 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:02.439831 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:02.458390 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:02.460824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:02.462240 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a6d6077e-ecce-4f15-b1c1-3a2daa858800 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.223366 Aug 10 23:18:02.465420 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 230/451] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:02 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:18:03.486431 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:03.487121 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:03.494330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:03.494838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:03.495272 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:03.496172 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:03.496627 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:03.497147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:03.651500 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:03.661216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:03.665420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:03.667720 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b86befa4-1f3b-4be3-ab1e-394b9506c408 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.185076 Aug 10 23:18:03.684250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 222/452] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:03 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:04.693637 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:04.694805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:04.701272 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:04.702096 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:04.702879 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:04.703803 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:04.704471 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:04.705104 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:04.889725 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:04.900699 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:04.902406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:04.903734 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b1c8ca07-ce03-4abe-9f14-0726d32b590e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.214227 Aug 10 23:18:04.904716 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 231/453] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:04 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:05.932389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:05.933022 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:05.940760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:05.941282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:05.941726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:05.942444 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:05.942943 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:05.943611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:06.098039 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:06.102038 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:06.103932 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:06.105398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2f95577e-3a6e-4662-b06e-eac768028338 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.178138 Aug 10 23:18:06.106505 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 223/454] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:05 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:07.138871 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:07.139524 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:07.151590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:07.152071 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:07.152582 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:07.153593 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:07.154045 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:07.154523 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:07.669776 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:07.696330 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:07.698893 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:07.700686 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7b9b9f07-d367-4508-a8a1-32c6db974b11 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.566531 Aug 10 23:18:07.701593 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 232/455] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:07 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:08.727231 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:08.727866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:08.743892 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:08.744467 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:08.745178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:08.746355 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:08.746931 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:08.747678 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:08.910544 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:08.926096 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:08.929864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:08.931259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-20ec9b9d-a36a-4299-b357-c9ec8973cf91 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.209343 Aug 10 23:18:08.955360 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 224/456] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:08 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:09.969393 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:09.971216 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:09.979295 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:09.980029 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:09.980782 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:09.981663 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:09.982273 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:09.982898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:10.170261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:10.181442 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:10.183347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:10.184528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c314e6ce-a6f1-49d3-963a-98be5201ff6b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.222623 Aug 10 23:18:10.185086 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 233/457] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:09 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:11.212065 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:11.228994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:11.228994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.228994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.228994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.229375 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.229375 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.229375 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.471538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:11.482979 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:11.485993 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:11.488913 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2a62cf30-050a-43c8-bf18-1ff46c52398b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.281245 Aug 10 23:18:11.489690 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 225/458] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:11 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:12.516204 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:12.516846 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:12.523164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:12.523635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:12.524065 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:12.524749 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:12.525193 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:12.525612 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:12.659556 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:12.669809 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:12.671384 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:12.672608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7908119e-e922-4fa2-aacc-9608632f6bcb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.160252 Aug 10 23:18:12.673482 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 234/459] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:12 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:13.695819 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:13.696473 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:13.702948 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:13.703439 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:13.703877 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:13.704617 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:13.705077 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:13.705504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:13.839168 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:13.847988 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:13.849495 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:13.850648 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6e19a4d2-16f0-40c0-9906-464c35f34f87 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.159352 Aug 10 23:18:13.851230 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 226/460] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:13 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:14.875848 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:14.876455 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:14.883430 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:14.884002 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:14.884375 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:14.885034 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:14.885600 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:14.885914 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:15.018398 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:15.027753 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:15.029267 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:15.030428 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b67365da-4624-4218-af60-ce8aa7705c6f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.158426 Aug 10 23:18:15.031171 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 235/461] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:14 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:16.053579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:16.054115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:16.060509 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:16.060989 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:16.061424 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:16.062120 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:16.062573 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:16.063030 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:16.206239 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:16.217072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:16.218868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:16.220018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-856155b5-2e12-49aa-8855-e6fd8048b842 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.170542 Aug 10 23:18:16.220583 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 227/462] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:16 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:18:17.245515 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:17.246470 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:17.253131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:17.253616 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:17.254046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:17.254756 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:17.255265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:17.255779 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:17.387078 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:17.396261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:17.398290 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:17.399505 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a8d23e3f-59bb-4005-93e0-9b7ee12c44d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.158852 Aug 10 23:18:17.400177 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 236/463] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:17 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:18.423095 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:18.423721 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:18.430816 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:18.431314 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:18.431740 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:18.432623 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:18.433081 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:18.433510 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:18.570176 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:18.579603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:18.581211 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:18.582367 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3e70b033-b2d5-40f3-92cd-fd514b232923 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.163487 Aug 10 23:18:18.582949 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 228/464] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:18 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:19.605988 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:19.606623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:19.613045 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:19.613517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:19.613948 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:19.614627 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:19.615098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:19.617316 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:19.750818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:19.759459 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:19.761066 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:19.762203 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1237b337-bbb6-4cb3-990a-37bc5ae31dca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.160207 Aug 10 23:18:19.762792 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 237/465] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:19 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:20.786271 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:20.786912 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:20.794019 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:20.794494 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:20.794957 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:20.795666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:20.796123 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:20.796541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:20.932422 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:20.940867 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:20.942352 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:20.943532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f67180e4-c64e-4a74-884d-fe55459b7459 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.161449 Aug 10 23:18:20.944080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 229/466] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:20 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:21.527532 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6bcf9f6e-808c-4da6-bc15-d70f647dce70 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:21.529814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6bcf9f6e-808c-4da6-bc15-d70f647dce70 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:21.536335 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6bcf9f6e-808c-4da6-bc15-d70f647dce70 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.537080 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6bcf9f6e-808c-4da6-bc15-d70f647dce70 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.537571 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6bcf9f6e-808c-4da6-bc15-d70f647dce70 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.538268 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6bcf9f6e-808c-4da6-bc15-d70f647dce70 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.538787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6bcf9f6e-808c-4da6-bc15-d70f647dce70 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.539191 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6bcf9f6e-808c-4da6-bc15-d70f647dce70 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.563371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-6bcf9f6e-808c-4da6-bc15-d70f647dce70 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lazy-loading 'flavor' on Instance uuid f942a5b6-08d7-4d52-a7bd-1af4aaba1930 {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:18:21.971886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:21.972776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:21.975210 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=27 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:21.982294 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.982854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.983546 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.984282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.984745 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.985238 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:22.040169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:22.149780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:22.159023 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:22.160777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:22.162042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-89b46d4a-deb7-444f-8f1d-6b5c62742b6e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.194871 Aug 10 23:18:22.163568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 230/467] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:21 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:22.168903 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-0aafb2c5-7940-4401-8317-f772cb8f9778 req-e43e1f55-1c52-491e-a6f2-fde569f7d6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d062824b-f7a6-4380-a622-5bba74816355", "name": "network-vif-plugged", "status": "completed", "tag": "6056ee81-d58a-4644-a5ae-8077d23b8e92"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:22.191159 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-0aafb2c5-7940-4401-8317-f772cb8f9778 req-e43e1f55-1c52-491e-a6f2-fde569f7d6d0 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:22.192008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-0aafb2c5-7940-4401-8317-f772cb8f9778 req-e43e1f55-1c52-491e-a6f2-fde569f7d6d0 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:22.192212 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6bcf9f6e-808c-4da6-bc15-d70f647dce70 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/action" status: 200 len: 32 microversion: 2.1 time: 0.668397 Aug 10 23:18:22.192780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 238/468] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:18:21 2022] POST /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/action => generated 32 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:18:22.197370 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-0aafb2c5-7940-4401-8317-f772cb8f9778 req-e43e1f55-1c52-491e-a6f2-fde569f7d6d0 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:22.207027 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c005a307-f746-400d-b1dd-f16fad374874 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:22.207870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c005a307-f746-400d-b1dd-f16fad374874 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:22.210091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:22.215432 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c005a307-f746-400d-b1dd-f16fad374874 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:22.215924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c005a307-f746-400d-b1dd-f16fad374874 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:22.216369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c005a307-f746-400d-b1dd-f16fad374874 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:22.217084 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c005a307-f746-400d-b1dd-f16fad374874 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:22.217544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c005a307-f746-400d-b1dd-f16fad374874 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:22.218354 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c005a307-f746-400d-b1dd-f16fad374874 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:22.246457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-0aafb2c5-7940-4401-8317-f772cb8f9778 req-e43e1f55-1c52-491e-a6f2-fde569f7d6d0 service nova] Creating event network-vif-plugged:6056ee81-d58a-4644-a5ae-8077d23b8e92 for instance d062824b-f7a6-4380-a622-5bba74816355 on hv-cinder-85144 Aug 10 23:18:22.251791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-0aafb2c5-7940-4401-8317-f772cb8f9778 req-e43e1f55-1c52-491e-a6f2-fde569f7d6d0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086287 Aug 10 23:18:22.252869 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 231/469] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:22.390758 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c005a307-f746-400d-b1dd-f16fad374874 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:22.400909 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c005a307-f746-400d-b1dd-f16fad374874 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.198219 Aug 10 23:18:22.401491 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 239/470] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:22 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:23.189483 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:23.191010 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:23.198035 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:23.198538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:23.198992 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:23.199698 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:23.200153 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:23.200580 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:23.413162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:23.424052 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fd2fea83-1342-4fd7-b71d-f7d99edd9cfc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:23.425475 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-fd2fea83-1342-4fd7-b71d-f7d99edd9cfc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:23.436767 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:23.437821 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fd2fea83-1342-4fd7-b71d-f7d99edd9cfc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:23.438320 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:23.438535 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fd2fea83-1342-4fd7-b71d-f7d99edd9cfc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:23.439118 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fd2fea83-1342-4fd7-b71d-f7d99edd9cfc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:23.439566 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8489fb8d-4ee5-4b11-a2c2-eca8f70d7346 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.255152 Aug 10 23:18:23.440036 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fd2fea83-1342-4fd7-b71d-f7d99edd9cfc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:23.440186 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 232/471] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:23 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:23.440856 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fd2fea83-1342-4fd7-b71d-f7d99edd9cfc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:23.441461 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fd2fea83-1342-4fd7-b71d-f7d99edd9cfc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:23.672767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-fd2fea83-1342-4fd7-b71d-f7d99edd9cfc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:23.688216 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-fd2fea83-1342-4fd7-b71d-f7d99edd9cfc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.268878 Aug 10 23:18:23.690739 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 240/472] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:23 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:24.465029 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:24.468755 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:24.472128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:24.472653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:24.473090 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:24.473779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:24.474231 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:24.474696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:24.624027 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:24.635942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:24.637751 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:24.639861 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-857a1eb6-064a-430f-adad-ee0ab0eac91b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.178008 Aug 10 23:18:24.641059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 233/473] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:24 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:24.715349 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4d4c13e6-309b-48c2-8a97-0c8d8bd7a20f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:24.716959 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4d4c13e6-309b-48c2-8a97-0c8d8bd7a20f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:24.729478 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4d4c13e6-309b-48c2-8a97-0c8d8bd7a20f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:24.730348 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4d4c13e6-309b-48c2-8a97-0c8d8bd7a20f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:24.731097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4d4c13e6-309b-48c2-8a97-0c8d8bd7a20f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:24.732094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4d4c13e6-309b-48c2-8a97-0c8d8bd7a20f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:24.733013 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4d4c13e6-309b-48c2-8a97-0c8d8bd7a20f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:24.733714 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4d4c13e6-309b-48c2-8a97-0c8d8bd7a20f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:24.892046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4d4c13e6-309b-48c2-8a97-0c8d8bd7a20f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:24.902045 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4d4c13e6-309b-48c2-8a97-0c8d8bd7a20f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.194004 Aug 10 23:18:24.903006 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 241/474] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:24 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:25.666297 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:25.666953 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:25.674343 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:25.675060 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:25.675742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:25.676523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:25.677039 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:25.677759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:25.861682 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:25.870929 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:25.872708 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:25.874307 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ef9cbbf1-0f1b-4270-8ddd-e030f4c55021 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.213910 Aug 10 23:18:25.887239 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 234/475] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:25 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:25.924960 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-920d8707-a7ec-43ad-b4f0-1b181496868c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:25.926140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-920d8707-a7ec-43ad-b4f0-1b181496868c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:25.936805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-920d8707-a7ec-43ad-b4f0-1b181496868c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:25.937292 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-920d8707-a7ec-43ad-b4f0-1b181496868c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:25.937722 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-920d8707-a7ec-43ad-b4f0-1b181496868c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:25.938430 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-920d8707-a7ec-43ad-b4f0-1b181496868c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:25.938907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-920d8707-a7ec-43ad-b4f0-1b181496868c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:25.939336 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-920d8707-a7ec-43ad-b4f0-1b181496868c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:26.123233 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-920d8707-a7ec-43ad-b4f0-1b181496868c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:26.129353 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-920d8707-a7ec-43ad-b4f0-1b181496868c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.209089 Aug 10 23:18:26.129925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 242/476] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:25 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:26.898292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:26.900361 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:26.908906 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:26.909396 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:26.909830 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:26.912884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:26.912884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:26.912884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:26.933361 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:27.057756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:27.067212 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:27.069202 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:27.070708 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7710878d-c751-4783-af4e-63525edc6c71 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1809 microversion: 2.20 time: 0.177164 Aug 10 23:18:27.071827 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 235/477] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:26 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:27.151906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3f6bcf4c-0b46-495e-ab3d-236f97e65af1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:27.152715 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3f6bcf4c-0b46-495e-ab3d-236f97e65af1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:27.158883 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f6bcf4c-0b46-495e-ab3d-236f97e65af1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:27.159566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f6bcf4c-0b46-495e-ab3d-236f97e65af1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:27.160298 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f6bcf4c-0b46-495e-ab3d-236f97e65af1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:27.161007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f6bcf4c-0b46-495e-ab3d-236f97e65af1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:27.161454 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f6bcf4c-0b46-495e-ab3d-236f97e65af1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:27.162074 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f6bcf4c-0b46-495e-ab3d-236f97e65af1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:27.302348 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3f6bcf4c-0b46-495e-ab3d-236f97e65af1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:27.310556 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3f6bcf4c-0b46-495e-ab3d-236f97e65af1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.162748 Aug 10 23:18:27.311278 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 243/478] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:27 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:28.095782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:28.097013 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:28.104934 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:28.105434 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:28.105873 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:28.106814 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:28.107446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:28.107876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:28.302647 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:28.315153 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:28.317105 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:28.318859 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4371e660-2f48-41a3-aea7-e74770b55e57 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1796 microversion: 2.20 time: 0.227464 Aug 10 23:18:28.320152 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 236/479] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:28 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1796 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:28.336479 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-37b30d34-d58d-4deb-85e6-b1f7cf083120 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:28.337151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-37b30d34-d58d-4deb-85e6-b1f7cf083120 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:28.345669 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37b30d34-d58d-4deb-85e6-b1f7cf083120 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:28.346223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37b30d34-d58d-4deb-85e6-b1f7cf083120 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:28.346602 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37b30d34-d58d-4deb-85e6-b1f7cf083120 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:28.347439 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37b30d34-d58d-4deb-85e6-b1f7cf083120 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:28.347893 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37b30d34-d58d-4deb-85e6-b1f7cf083120 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:28.348322 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37b30d34-d58d-4deb-85e6-b1f7cf083120 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:28.596619 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-37b30d34-d58d-4deb-85e6-b1f7cf083120 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:28.605798 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-37b30d34-d58d-4deb-85e6-b1f7cf083120 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.273508 Aug 10 23:18:28.607165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 244/480] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:28 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:29.627876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5eb2eecd-80b2-4640-b21a-1b46b9584154 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:29.629016 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5eb2eecd-80b2-4640-b21a-1b46b9584154 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:29.639548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5eb2eecd-80b2-4640-b21a-1b46b9584154 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:29.642295 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5eb2eecd-80b2-4640-b21a-1b46b9584154 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:29.642953 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5eb2eecd-80b2-4640-b21a-1b46b9584154 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:29.643904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5eb2eecd-80b2-4640-b21a-1b46b9584154 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:29.644408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5eb2eecd-80b2-4640-b21a-1b46b9584154 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:29.644971 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5eb2eecd-80b2-4640-b21a-1b46b9584154 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:29.923870 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5eb2eecd-80b2-4640-b21a-1b46b9584154 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:29.931244 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5eb2eecd-80b2-4640-b21a-1b46b9584154 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.307185 Aug 10 23:18:29.931838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 237/481] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:29 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:30.953201 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d3604cc0-29d5-4939-b137-d0f7d4b30346 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:30.953810 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d3604cc0-29d5-4939-b137-d0f7d4b30346 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:30.960760 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3604cc0-29d5-4939-b137-d0f7d4b30346 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:30.961240 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3604cc0-29d5-4939-b137-d0f7d4b30346 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:30.961692 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3604cc0-29d5-4939-b137-d0f7d4b30346 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:30.962381 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3604cc0-29d5-4939-b137-d0f7d4b30346 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:30.963010 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3604cc0-29d5-4939-b137-d0f7d4b30346 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:30.963436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3604cc0-29d5-4939-b137-d0f7d4b30346 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:31.442346 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d3604cc0-29d5-4939-b137-d0f7d4b30346 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:31.451854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d3604cc0-29d5-4939-b137-d0f7d4b30346 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.502655 Aug 10 23:18:31.452469 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 245/482] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:30 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:32.473703 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-758e21bb-b26b-4d89-a6ca-d98dd11167db tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:32.474327 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-758e21bb-b26b-4d89-a6ca-d98dd11167db tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:32.494187 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-758e21bb-b26b-4d89-a6ca-d98dd11167db tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:32.494716 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-758e21bb-b26b-4d89-a6ca-d98dd11167db tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:32.495165 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-758e21bb-b26b-4d89-a6ca-d98dd11167db tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:32.495888 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-758e21bb-b26b-4d89-a6ca-d98dd11167db tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:32.496340 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-758e21bb-b26b-4d89-a6ca-d98dd11167db tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:32.496966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-758e21bb-b26b-4d89-a6ca-d98dd11167db tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:32.766751 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-758e21bb-b26b-4d89-a6ca-d98dd11167db tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:32.773155 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-758e21bb-b26b-4d89-a6ca-d98dd11167db tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.303499 Aug 10 23:18:32.773752 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 238/483] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:32 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:33.143073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0f309977-b522-4233-b07e-c25b55861dc5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Action: 'create', calling method: .version_select at 0x7fe833f55280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1536175681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLp4D+MaIu0+f26d4rLfaGZ2QeugbZAnxPmWY/U7mHXmpwm3eKjhqq3CVxY0p6xUJFEnylUVswXDAmRq1cdhUgjJhV7JP9n20H19ohZv+GGfnmL5HPM+NUFVT2WP7DZ4fQ=="}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:33.159337 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-0f309977-b522-4233-b07e-c25b55861dc5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Getting quotas for project e855cc11f6a142f9a6d31088812beeef. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:18:33.163383 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-0f309977-b522-4233-b07e-c25b55861dc5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Getting quotas for user d0a56142f0fc4c32b7e34ec74803407f and project e855cc11f6a142f9a6d31088812beeef. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:18:33.282816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0f309977-b522-4233-b07e-c25b55861dc5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.331834 Aug 10 23:18:33.284628 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 246/484] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 10 23:18:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:33.794605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8a0732d9-ae84-4db0-8612-e454654c189e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:33.795246 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8a0732d9-ae84-4db0-8612-e454654c189e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:33.801884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a0732d9-ae84-4db0-8612-e454654c189e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:33.802395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a0732d9-ae84-4db0-8612-e454654c189e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:33.802876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a0732d9-ae84-4db0-8612-e454654c189e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:33.803637 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a0732d9-ae84-4db0-8612-e454654c189e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:33.804268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a0732d9-ae84-4db0-8612-e454654c189e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:33.804859 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a0732d9-ae84-4db0-8612-e454654c189e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:33.978873 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8a0732d9-ae84-4db0-8612-e454654c189e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:33.987029 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8a0732d9-ae84-4db0-8612-e454654c189e tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.196189 Aug 10 23:18:33.987603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 239/485] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:33 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:35.009107 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-92615dca-ed77-4a55-97e7-7e75bcaecc07 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:35.009719 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-92615dca-ed77-4a55-97e7-7e75bcaecc07 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:35.016451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92615dca-ed77-4a55-97e7-7e75bcaecc07 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:35.016927 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92615dca-ed77-4a55-97e7-7e75bcaecc07 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:35.017357 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92615dca-ed77-4a55-97e7-7e75bcaecc07 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:35.018042 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92615dca-ed77-4a55-97e7-7e75bcaecc07 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:35.018610 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92615dca-ed77-4a55-97e7-7e75bcaecc07 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:35.019070 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-92615dca-ed77-4a55-97e7-7e75bcaecc07 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:35.155906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-92615dca-ed77-4a55-97e7-7e75bcaecc07 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:35.165425 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-92615dca-ed77-4a55-97e7-7e75bcaecc07 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.160459 Aug 10 23:18:35.166101 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 247/486] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:35 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:36.191279 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8382cbe4-6b9d-4eeb-b8cb-30f066126ba8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:36.192148 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8382cbe4-6b9d-4eeb-b8cb-30f066126ba8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:36.198927 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8382cbe4-6b9d-4eeb-b8cb-30f066126ba8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:36.199406 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8382cbe4-6b9d-4eeb-b8cb-30f066126ba8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:36.199908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8382cbe4-6b9d-4eeb-b8cb-30f066126ba8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:36.200686 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8382cbe4-6b9d-4eeb-b8cb-30f066126ba8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:36.201324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8382cbe4-6b9d-4eeb-b8cb-30f066126ba8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:36.201931 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8382cbe4-6b9d-4eeb-b8cb-30f066126ba8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:36.366171 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8382cbe4-6b9d-4eeb-b8cb-30f066126ba8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:36.375776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8382cbe4-6b9d-4eeb-b8cb-30f066126ba8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.188739 Aug 10 23:18:36.386929 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 240/487] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:36 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:37.398464 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0eca34df-3198-4f3a-8c01-158ab4ffaa74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:37.399226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0eca34df-3198-4f3a-8c01-158ab4ffaa74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:37.405871 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0eca34df-3198-4f3a-8c01-158ab4ffaa74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:37.406357 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0eca34df-3198-4f3a-8c01-158ab4ffaa74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:37.406822 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0eca34df-3198-4f3a-8c01-158ab4ffaa74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:37.407941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0eca34df-3198-4f3a-8c01-158ab4ffaa74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:37.407941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0eca34df-3198-4f3a-8c01-158ab4ffaa74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:37.408382 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0eca34df-3198-4f3a-8c01-158ab4ffaa74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:37.547276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0eca34df-3198-4f3a-8c01-158ab4ffaa74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:37.555370 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0eca34df-3198-4f3a-8c01-158ab4ffaa74 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.160859 Aug 10 23:18:37.555948 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 248/488] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:37 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:38.576873 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c9e89559-0f03-44c9-a5c0-31d2b13b556b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:38.577520 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c9e89559-0f03-44c9-a5c0-31d2b13b556b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:38.584137 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c9e89559-0f03-44c9-a5c0-31d2b13b556b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:38.584642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c9e89559-0f03-44c9-a5c0-31d2b13b556b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:38.585309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c9e89559-0f03-44c9-a5c0-31d2b13b556b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:38.586024 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c9e89559-0f03-44c9-a5c0-31d2b13b556b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:38.586479 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c9e89559-0f03-44c9-a5c0-31d2b13b556b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:38.586929 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c9e89559-0f03-44c9-a5c0-31d2b13b556b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:38.746647 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c9e89559-0f03-44c9-a5c0-31d2b13b556b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:38.754690 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c9e89559-0f03-44c9-a5c0-31d2b13b556b tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.181794 Aug 10 23:18:38.755251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 241/489] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:38 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:39.776542 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9a0e1135-8960-40e0-87c1-216ff4e4a6e8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:39.777160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9a0e1135-8960-40e0-87c1-216ff4e4a6e8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:39.783701 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a0e1135-8960-40e0-87c1-216ff4e4a6e8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:39.784227 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a0e1135-8960-40e0-87c1-216ff4e4a6e8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:39.784671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a0e1135-8960-40e0-87c1-216ff4e4a6e8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:39.785392 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a0e1135-8960-40e0-87c1-216ff4e4a6e8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:39.785852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a0e1135-8960-40e0-87c1-216ff4e4a6e8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:39.786282 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9a0e1135-8960-40e0-87c1-216ff4e4a6e8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:39.919543 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-9a0e1135-8960-40e0-87c1-216ff4e4a6e8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:39.927713 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9a0e1135-8960-40e0-87c1-216ff4e4a6e8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.155114 Aug 10 23:18:39.928336 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 249/490] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:39 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:40.951489 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a1bf44e2-cd88-4252-bab3-aff7a91f3941 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:40.952103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a1bf44e2-cd88-4252-bab3-aff7a91f3941 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:40.958513 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1bf44e2-cd88-4252-bab3-aff7a91f3941 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:40.959033 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1bf44e2-cd88-4252-bab3-aff7a91f3941 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:40.959470 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1bf44e2-cd88-4252-bab3-aff7a91f3941 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:40.960164 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1bf44e2-cd88-4252-bab3-aff7a91f3941 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:40.960617 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1bf44e2-cd88-4252-bab3-aff7a91f3941 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:40.961695 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1bf44e2-cd88-4252-bab3-aff7a91f3941 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:41.090027 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a1bf44e2-cd88-4252-bab3-aff7a91f3941 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:41.099152 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a1bf44e2-cd88-4252-bab3-aff7a91f3941 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.151427 Aug 10 23:18:41.099738 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 242/491] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:40 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:42.120645 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7292c543-1307-475f-9296-47e17e75c575 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:42.121298 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7292c543-1307-475f-9296-47e17e75c575 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:42.127279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7292c543-1307-475f-9296-47e17e75c575 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:42.127756 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7292c543-1307-475f-9296-47e17e75c575 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:42.128182 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7292c543-1307-475f-9296-47e17e75c575 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:42.128877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7292c543-1307-475f-9296-47e17e75c575 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:42.129322 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7292c543-1307-475f-9296-47e17e75c575 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:42.129744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7292c543-1307-475f-9296-47e17e75c575 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:42.261775 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7292c543-1307-475f-9296-47e17e75c575 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:42.269937 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7292c543-1307-475f-9296-47e17e75c575 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.153944 Aug 10 23:18:42.270503 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 250/492] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:42 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:43.291923 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fa5c5896-8682-4327-8a01-3c770830d14d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:43.292688 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-fa5c5896-8682-4327-8a01-3c770830d14d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:43.300307 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fa5c5896-8682-4327-8a01-3c770830d14d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:43.300829 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fa5c5896-8682-4327-8a01-3c770830d14d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:43.301294 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fa5c5896-8682-4327-8a01-3c770830d14d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:43.301997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fa5c5896-8682-4327-8a01-3c770830d14d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:43.302458 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fa5c5896-8682-4327-8a01-3c770830d14d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:43.302943 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fa5c5896-8682-4327-8a01-3c770830d14d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:43.440480 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-fa5c5896-8682-4327-8a01-3c770830d14d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:43.451105 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-fa5c5896-8682-4327-8a01-3c770830d14d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1735 microversion: 2.1 time: 0.164251 Aug 10 23:18:43.454333 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 243/493] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:43 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:44.480208 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-44f8fce9-2050-4e5a-b9ca-5031a11a19d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:44.480817 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-44f8fce9-2050-4e5a-b9ca-5031a11a19d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:44.483176 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=4 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:44.488016 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44f8fce9-2050-4e5a-b9ca-5031a11a19d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:44.488502 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44f8fce9-2050-4e5a-b9ca-5031a11a19d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:44.488940 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44f8fce9-2050-4e5a-b9ca-5031a11a19d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:44.489636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44f8fce9-2050-4e5a-b9ca-5031a11a19d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:44.490092 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44f8fce9-2050-4e5a-b9ca-5031a11a19d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:44.490521 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44f8fce9-2050-4e5a-b9ca-5031a11a19d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:44.624240 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-44f8fce9-2050-4e5a-b9ca-5031a11a19d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:44.632318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-44f8fce9-2050-4e5a-b9ca-5031a11a19d8 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1715 microversion: 2.1 time: 0.156055 Aug 10 23:18:44.632886 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 251/494] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:44 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:18:44.692378 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:44.692863 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:44.699345 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:44.699899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:44.700337 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:44.701032 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:44.701588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:44.701913 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:44.826299 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] HTTP exception thrown: Cannot 'detach_volume' instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 while it is in vm_state rescued Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Request method failure captured: Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: DELETE /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments/660d91c8-9ea6-4e69-b0ca-0e33893af524 HTTP/1.1 Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DuabME7ZGHzYuz08OVq0R6TMPx--LgzVwK_UREHcD3-PQE3MaV4jBWp2AYr2OKi7kcY9Vep3prjScfU6CpAWsU3OQNYBRfCrSgAvD1_qxdd5aQVPMLlOmxehX_8VTrbZuX8lzptxALoTxaoIDfjKODnb2VEQefb9Lta9-c0yMzMMPY Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: be0d52e189904e3c9971960d3ff4f58b Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:18:44.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_be0d52e189904e3c9971960d3ff4f58b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: be0d52e189904e3c9971960d3ff4f58b Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-ServerRescueNegativeTestJSON-1544132578-project Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: ffb46379ef204df6bebd58f3bdb78ff6 Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1544132578-project Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:18:44.829731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Cannot 'detach_volume' instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 while it is in vm_state rescued Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'server_id': 'f942a5b6-08d7-4d52-a7bd-1af4aaba1930', 'id': '660d91c8-9ea6-4e69-b0ca-0e33893af524'} Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:18:44.830626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 while it is in vm_state rescued Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 while it is in vm_state rescued Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:18:44.832275 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Returning 409 to user: Cannot 'detach_volume' instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 while it is in vm_state rescued {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:18:44.833454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4955307c-3fed-4dd3-8d85-ae86b26030e6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments/660d91c8-9ea6-4e69-b0ca-0e33893af524" status: 409 len: 152 microversion: 2.1 time: 0.140891 Aug 10 23:18:44.833454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 244/495] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:18:44 2022] DELETE /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments/660d91c8-9ea6-4e69-b0ca-0e33893af524 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:18:44.838497 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-838811bf-0bfe-40c1-8e82-b7423495f5c6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:44.839065 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-838811bf-0bfe-40c1-8e82-b7423495f5c6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:44.845248 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-838811bf-0bfe-40c1-8e82-b7423495f5c6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:44.845728 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-838811bf-0bfe-40c1-8e82-b7423495f5c6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:44.846162 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-838811bf-0bfe-40c1-8e82-b7423495f5c6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:44.846892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-838811bf-0bfe-40c1-8e82-b7423495f5c6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:44.847346 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-838811bf-0bfe-40c1-8e82-b7423495f5c6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:44.847770 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-838811bf-0bfe-40c1-8e82-b7423495f5c6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:45.050029 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-838811bf-0bfe-40c1-8e82-b7423495f5c6 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "POST /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/action" status: 202 len: 0 microversion: 2.1 time: 0.215077 Aug 10 23:18:45.050723 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 252/496] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:18:44 2022] POST /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:18:45.064038 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ca4fa0a3-cbcb-43b0-972b-95273312a255 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:45.064653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ca4fa0a3-cbcb-43b0-972b-95273312a255 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:45.071244 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ca4fa0a3-cbcb-43b0-972b-95273312a255 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:45.071722 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ca4fa0a3-cbcb-43b0-972b-95273312a255 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:45.072179 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ca4fa0a3-cbcb-43b0-972b-95273312a255 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:45.072877 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ca4fa0a3-cbcb-43b0-972b-95273312a255 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:45.073324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ca4fa0a3-cbcb-43b0-972b-95273312a255 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:45.073744 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ca4fa0a3-cbcb-43b0-972b-95273312a255 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:45.520918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ca4fa0a3-cbcb-43b0-972b-95273312a255 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:45.529541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ca4fa0a3-cbcb-43b0-972b-95273312a255 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1723 microversion: 2.1 time: 0.469688 Aug 10 23:18:45.530216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 245/497] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:45 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:46.551153 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f48f5308-aba5-4163-a3b5-e80eae714bf0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:46.551796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f48f5308-aba5-4163-a3b5-e80eae714bf0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:46.558974 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f48f5308-aba5-4163-a3b5-e80eae714bf0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:46.559463 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f48f5308-aba5-4163-a3b5-e80eae714bf0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:46.559905 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f48f5308-aba5-4163-a3b5-e80eae714bf0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:46.560594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f48f5308-aba5-4163-a3b5-e80eae714bf0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:46.561049 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f48f5308-aba5-4163-a3b5-e80eae714bf0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:46.561477 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f48f5308-aba5-4163-a3b5-e80eae714bf0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:46.697032 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f48f5308-aba5-4163-a3b5-e80eae714bf0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:46.704973 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f48f5308-aba5-4163-a3b5-e80eae714bf0 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1723 microversion: 2.1 time: 0.158127 Aug 10 23:18:46.705536 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 253/498] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:46 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:47.734195 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d2a2fab6-66af-4555-ba36-b8a3944f8d9d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:47.734195 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d2a2fab6-66af-4555-ba36-b8a3944f8d9d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:47.734195 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d2a2fab6-66af-4555-ba36-b8a3944f8d9d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:47.734195 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d2a2fab6-66af-4555-ba36-b8a3944f8d9d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:47.735100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d2a2fab6-66af-4555-ba36-b8a3944f8d9d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:47.735100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d2a2fab6-66af-4555-ba36-b8a3944f8d9d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:47.735100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d2a2fab6-66af-4555-ba36-b8a3944f8d9d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:47.735431 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d2a2fab6-66af-4555-ba36-b8a3944f8d9d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:47.863256 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d2a2fab6-66af-4555-ba36-b8a3944f8d9d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:47.871806 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d2a2fab6-66af-4555-ba36-b8a3944f8d9d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1723 microversion: 2.1 time: 0.150353 Aug 10 23:18:47.872562 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 246/499] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:47 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:48.894362 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4c3ec5af-44d7-4a08-8791-0cfe23b5978d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:48.895275 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4c3ec5af-44d7-4a08-8791-0cfe23b5978d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:48.910947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3ec5af-44d7-4a08-8791-0cfe23b5978d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:48.911435 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3ec5af-44d7-4a08-8791-0cfe23b5978d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:48.911868 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3ec5af-44d7-4a08-8791-0cfe23b5978d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:48.912571 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3ec5af-44d7-4a08-8791-0cfe23b5978d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:48.913023 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3ec5af-44d7-4a08-8791-0cfe23b5978d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:48.913447 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c3ec5af-44d7-4a08-8791-0cfe23b5978d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:49.049751 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4c3ec5af-44d7-4a08-8791-0cfe23b5978d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:49.059127 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4c3ec5af-44d7-4a08-8791-0cfe23b5978d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1723 microversion: 2.1 time: 0.168454 Aug 10 23:18:49.059697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 254/500] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:48 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:50.080747 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-66312574-0d52-4636-aa80-7368e7d498cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:50.081391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-66312574-0d52-4636-aa80-7368e7d498cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:50.087991 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66312574-0d52-4636-aa80-7368e7d498cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:50.088468 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66312574-0d52-4636-aa80-7368e7d498cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:50.088902 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66312574-0d52-4636-aa80-7368e7d498cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:50.089600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66312574-0d52-4636-aa80-7368e7d498cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:50.090053 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66312574-0d52-4636-aa80-7368e7d498cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:50.090479 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-66312574-0d52-4636-aa80-7368e7d498cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:50.216603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-66312574-0d52-4636-aa80-7368e7d498cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:50.225073 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-66312574-0d52-4636-aa80-7368e7d498cb tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1729 microversion: 2.1 time: 0.148154 Aug 10 23:18:50.227427 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 247/501] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:50 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:50.252046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4c7c7086-0d2f-43cb-8794-c70b879a6efa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:50.252926 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4c7c7086-0d2f-43cb-8794-c70b879a6efa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:50.264383 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c7c7086-0d2f-43cb-8794-c70b879a6efa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:50.265274 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c7c7086-0d2f-43cb-8794-c70b879a6efa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:50.265793 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c7c7086-0d2f-43cb-8794-c70b879a6efa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:50.271019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c7c7086-0d2f-43cb-8794-c70b879a6efa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:50.271493 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c7c7086-0d2f-43cb-8794-c70b879a6efa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:50.271927 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4c7c7086-0d2f-43cb-8794-c70b879a6efa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:50.290837 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:50.355068 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4c7c7086-0d2f-43cb-8794-c70b879a6efa tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112128 Aug 10 23:18:50.355661 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 255/502] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 10 23:18:50 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:51.279119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-8d48963f-0a29-42b7-9dad-c8ddffbdb56d req-d3a20e54-55f8-4745-90cf-a6a3f659a54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f942a5b6-08d7-4d52-a7bd-1af4aaba1930", "tag": "a4fdf480-4b42-4de5-8380-f1aec638d9a7"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:51.290788 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-8d48963f-0a29-42b7-9dad-c8ddffbdb56d req-d3a20e54-55f8-4745-90cf-a6a3f659a54f service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:51.291325 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-8d48963f-0a29-42b7-9dad-c8ddffbdb56d req-d3a20e54-55f8-4745-90cf-a6a3f659a54f service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:51.294209 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-8d48963f-0a29-42b7-9dad-c8ddffbdb56d req-d3a20e54-55f8-4745-90cf-a6a3f659a54f service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:51.304227 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-8d48963f-0a29-42b7-9dad-c8ddffbdb56d req-d3a20e54-55f8-4745-90cf-a6a3f659a54f service nova] Creating event network-changed:a4fdf480-4b42-4de5-8380-f1aec638d9a7 for instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 on hv-cinder-85144 Aug 10 23:18:51.309844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-8d48963f-0a29-42b7-9dad-c8ddffbdb56d req-d3a20e54-55f8-4745-90cf-a6a3f659a54f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034688 Aug 10 23:18:51.310477 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 248/503] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:53.325406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-1243568e-cebe-4b84-af6c-c7fb76edf965 req-5187c469-e614-496d-9a54-a7822accd766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f942a5b6-08d7-4d52-a7bd-1af4aaba1930", "tag": "a4fdf480-4b42-4de5-8380-f1aec638d9a7"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:53.334870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-1243568e-cebe-4b84-af6c-c7fb76edf965 req-5187c469-e614-496d-9a54-a7822accd766 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:53.335342 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-1243568e-cebe-4b84-af6c-c7fb76edf965 req-5187c469-e614-496d-9a54-a7822accd766 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:53.335771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-1243568e-cebe-4b84-af6c-c7fb76edf965 req-5187c469-e614-496d-9a54-a7822accd766 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:53.346920 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-1243568e-cebe-4b84-af6c-c7fb76edf965 req-5187c469-e614-496d-9a54-a7822accd766 service nova] Creating event network-changed:a4fdf480-4b42-4de5-8380-f1aec638d9a7 for instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 on hv-cinder-85144 Aug 10 23:18:53.351850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-1243568e-cebe-4b84-af6c-c7fb76edf965 req-5187c469-e614-496d-9a54-a7822accd766 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031278 Aug 10 23:18:53.352524 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 256/504] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:00.465646 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-416334574", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1536175681", "security_groups": [{"name": "tempest-secgroup-smoke-568622046"}], "networks": [{"uuid": "452ad5c1-c5ba-45f3-a0e2-dc7eacb96c02"}], "block_device_mapping_v2": [{"uuid": "a84b1d23-a04d-4e84-b5ad-1fa7f022d937", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:00.475532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=38 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:00.582841 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] validate_networks() for [('452ad5c1-c5ba-45f3-a0e2-dc7eacb96c02', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:19:00.986877 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:19:00.987302 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:19:00.987797 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:19:00.988210 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:19:00.988616 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:19:00.997813 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:00.998286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:00.999148 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:00.999587 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:01.000036 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:01.000453 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:01.006932 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=79 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:01.017869 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Getting quotas for project e855cc11f6a142f9a6d31088812beeef. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:01.023598 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Getting quotas for user d0a56142f0fc4c32b7e34ec74803407f and project e855cc11f6a142f9a6d31088812beeef. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:01.078131 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:19:01.080403 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a84b1d23-a04d-4e84-b5ad-1fa7f022d937',volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:19:01.544920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2a5145d7-8788-451a-84d0-ed15f14ecd6e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.084737 Aug 10 23:19:01.546711 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 249/505] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:19:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:19:01.557639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f48da3d3-51e1-4398-b8b6-6667574fa6ab tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:01.558361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f48da3d3-51e1-4398-b8b6-6667574fa6ab tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:01.560634 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:01.614108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f48da3d3-51e1-4398-b8b6-6667574fa6ab tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:01.621401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f48da3d3-51e1-4398-b8b6-6667574fa6ab tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1088 microversion: 2.1 time: 0.068819 Aug 10 23:19:01.621967 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 257/506] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:01 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:02.642010 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8e71ad74-7433-43c1-b831-5da4ade127cd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:02.642624 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8e71ad74-7433-43c1-b831-5da4ade127cd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:02.649813 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e71ad74-7433-43c1-b831-5da4ade127cd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:02.650302 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e71ad74-7433-43c1-b831-5da4ade127cd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:02.650756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e71ad74-7433-43c1-b831-5da4ade127cd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:02.651451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e71ad74-7433-43c1-b831-5da4ade127cd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:02.651899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e71ad74-7433-43c1-b831-5da4ade127cd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:02.652322 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e71ad74-7433-43c1-b831-5da4ade127cd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:02.713617 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8e71ad74-7433-43c1-b831-5da4ade127cd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:02.721532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8e71ad74-7433-43c1-b831-5da4ade127cd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1138 microversion: 2.1 time: 0.084073 Aug 10 23:19:02.722231 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 250/507] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:02 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:03.744995 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-97efe40c-ac92-4017-82ac-e3e1af63a073 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:03.745555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-97efe40c-ac92-4017-82ac-e3e1af63a073 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:03.747492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:03.752682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97efe40c-ac92-4017-82ac-e3e1af63a073 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:03.753176 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97efe40c-ac92-4017-82ac-e3e1af63a073 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:03.753613 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97efe40c-ac92-4017-82ac-e3e1af63a073 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:03.754331 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97efe40c-ac92-4017-82ac-e3e1af63a073 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:03.754817 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97efe40c-ac92-4017-82ac-e3e1af63a073 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:03.766949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-97efe40c-ac92-4017-82ac-e3e1af63a073 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:03.836293 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-97efe40c-ac92-4017-82ac-e3e1af63a073 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:03.844453 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-97efe40c-ac92-4017-82ac-e3e1af63a073 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1194 microversion: 2.1 time: 0.105088 Aug 10 23:19:03.845108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 258/508] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:03 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1194 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:04.866389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-148fe1a8-9d99-4cf2-8532-f9666f026908 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:04.868360 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-148fe1a8-9d99-4cf2-8532-f9666f026908 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:04.875732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-148fe1a8-9d99-4cf2-8532-f9666f026908 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:04.876227 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-148fe1a8-9d99-4cf2-8532-f9666f026908 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:04.876666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-148fe1a8-9d99-4cf2-8532-f9666f026908 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:04.877382 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-148fe1a8-9d99-4cf2-8532-f9666f026908 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:04.877844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-148fe1a8-9d99-4cf2-8532-f9666f026908 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:04.878276 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-148fe1a8-9d99-4cf2-8532-f9666f026908 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:05.236251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-148fe1a8-9d99-4cf2-8532-f9666f026908 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:05.243687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-148fe1a8-9d99-4cf2-8532-f9666f026908 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1271 microversion: 2.1 time: 0.382004 Aug 10 23:19:05.244450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 251/509] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:04 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1271 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:05.703022 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-4d3665dd-b1be-4f77-9631-966beada4046 req-48d74a9c-eb96-42f7-8af3-f82887aeb261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace5e95d-7b24-4111-ae18-7185b8662c79", "tag": "cd7e7501-d9b2-4b2f-9318-8204c144c269"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:05.712925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-4d3665dd-b1be-4f77-9631-966beada4046 req-48d74a9c-eb96-42f7-8af3-f82887aeb261 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:05.713393 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-4d3665dd-b1be-4f77-9631-966beada4046 req-48d74a9c-eb96-42f7-8af3-f82887aeb261 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:05.713816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-4d3665dd-b1be-4f77-9631-966beada4046 req-48d74a9c-eb96-42f7-8af3-f82887aeb261 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:05.725843 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-4d3665dd-b1be-4f77-9631-966beada4046 req-48d74a9c-eb96-42f7-8af3-f82887aeb261 service nova] Creating event network-changed:cd7e7501-d9b2-4b2f-9318-8204c144c269 for instance ace5e95d-7b24-4111-ae18-7185b8662c79 on hv-cinder-85144 Aug 10 23:19:05.731081 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-4d3665dd-b1be-4f77-9631-966beada4046 req-48d74a9c-eb96-42f7-8af3-f82887aeb261 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088931 Aug 10 23:19:05.731915 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 259/510] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:19:06.266259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-364abf47-2020-42c5-96c1-47cdd8dfec82 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:06.266879 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-364abf47-2020-42c5-96c1-47cdd8dfec82 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:06.273384 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-364abf47-2020-42c5-96c1-47cdd8dfec82 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.273917 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-364abf47-2020-42c5-96c1-47cdd8dfec82 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.274362 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-364abf47-2020-42c5-96c1-47cdd8dfec82 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.275087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-364abf47-2020-42c5-96c1-47cdd8dfec82 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.275546 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-364abf47-2020-42c5-96c1-47cdd8dfec82 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.275976 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-364abf47-2020-42c5-96c1-47cdd8dfec82 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.410339 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-364abf47-2020-42c5-96c1-47cdd8dfec82 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:06.418622 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-364abf47-2020-42c5-96c1-47cdd8dfec82 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.156589 Aug 10 23:19:06.419218 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 252/511] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:06 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:07.442533 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d3ea505d-65cb-4eb5-a5ab-487d16d32a9b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:07.443288 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d3ea505d-65cb-4eb5-a5ab-487d16d32a9b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:07.450103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3ea505d-65cb-4eb5-a5ab-487d16d32a9b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.450590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3ea505d-65cb-4eb5-a5ab-487d16d32a9b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.451088 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3ea505d-65cb-4eb5-a5ab-487d16d32a9b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.453327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3ea505d-65cb-4eb5-a5ab-487d16d32a9b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.453327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3ea505d-65cb-4eb5-a5ab-487d16d32a9b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.453327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d3ea505d-65cb-4eb5-a5ab-487d16d32a9b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.662095 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d3ea505d-65cb-4eb5-a5ab-487d16d32a9b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:07.669565 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d3ea505d-65cb-4eb5-a5ab-487d16d32a9b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.231695 Aug 10 23:19:07.670275 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 260/512] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:07 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:08.690232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1a89ea16-2af3-4ecd-9ada-a8647e9311c0 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:08.691060 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1a89ea16-2af3-4ecd-9ada-a8647e9311c0 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:08.699876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a89ea16-2af3-4ecd-9ada-a8647e9311c0 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:08.700415 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a89ea16-2af3-4ecd-9ada-a8647e9311c0 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:08.700858 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a89ea16-2af3-4ecd-9ada-a8647e9311c0 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:08.701573 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a89ea16-2af3-4ecd-9ada-a8647e9311c0 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:08.702030 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a89ea16-2af3-4ecd-9ada-a8647e9311c0 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:08.702459 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a89ea16-2af3-4ecd-9ada-a8647e9311c0 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:08.836373 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1a89ea16-2af3-4ecd-9ada-a8647e9311c0 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:08.844188 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1a89ea16-2af3-4ecd-9ada-a8647e9311c0 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.157924 Aug 10 23:19:08.844769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 253/513] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:08 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:09.864537 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-07f30526-9d80-4fc3-8d80-1270f6690baf tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:09.865073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-07f30526-9d80-4fc3-8d80-1270f6690baf tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:09.871537 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07f30526-9d80-4fc3-8d80-1270f6690baf tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.872020 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07f30526-9d80-4fc3-8d80-1270f6690baf tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.872457 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07f30526-9d80-4fc3-8d80-1270f6690baf tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:09.873150 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07f30526-9d80-4fc3-8d80-1270f6690baf tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.873994 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07f30526-9d80-4fc3-8d80-1270f6690baf tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.873994 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-07f30526-9d80-4fc3-8d80-1270f6690baf tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.004499 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-07f30526-9d80-4fc3-8d80-1270f6690baf tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:10.011957 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-07f30526-9d80-4fc3-8d80-1270f6690baf tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.151388 Aug 10 23:19:10.012521 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 261/514] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:09 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:11.032778 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5d564309-c459-40c2-9202-87deef4e2dae tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:11.033390 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5d564309-c459-40c2-9202-87deef4e2dae tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:11.035721 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:11.036394 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=6 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:11.041605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5d564309-c459-40c2-9202-87deef4e2dae tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:11.042087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5d564309-c459-40c2-9202-87deef4e2dae tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:11.042517 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5d564309-c459-40c2-9202-87deef4e2dae tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:11.043256 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5d564309-c459-40c2-9202-87deef4e2dae tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:11.043708 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5d564309-c459-40c2-9202-87deef4e2dae tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:11.052251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5d564309-c459-40c2-9202-87deef4e2dae tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:11.172855 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5d564309-c459-40c2-9202-87deef4e2dae tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:11.180934 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5d564309-c459-40c2-9202-87deef4e2dae tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.151930 Aug 10 23:19:11.181506 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 254/515] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:11 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:12.201256 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4f0e2424-27e4-4283-bc80-488b2825ee70 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:12.201900 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4f0e2424-27e4-4283-bc80-488b2825ee70 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:12.204391 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:12.209142 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4f0e2424-27e4-4283-bc80-488b2825ee70 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:12.209626 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4f0e2424-27e4-4283-bc80-488b2825ee70 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:12.210062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4f0e2424-27e4-4283-bc80-488b2825ee70 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:12.210788 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4f0e2424-27e4-4283-bc80-488b2825ee70 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:12.211245 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4f0e2424-27e4-4283-bc80-488b2825ee70 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:12.211675 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4f0e2424-27e4-4283-bc80-488b2825ee70 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:12.349881 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4f0e2424-27e4-4283-bc80-488b2825ee70 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:12.358056 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4f0e2424-27e4-4283-bc80-488b2825ee70 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.160671 Aug 10 23:19:12.358615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 262/516] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:12 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:13.379764 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ed7d0878-d50c-4a34-8da9-6e97f0d98336 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:13.380402 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ed7d0878-d50c-4a34-8da9-6e97f0d98336 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:13.387308 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed7d0878-d50c-4a34-8da9-6e97f0d98336 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:13.387787 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed7d0878-d50c-4a34-8da9-6e97f0d98336 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:13.388221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed7d0878-d50c-4a34-8da9-6e97f0d98336 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:13.388911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed7d0878-d50c-4a34-8da9-6e97f0d98336 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:13.389363 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed7d0878-d50c-4a34-8da9-6e97f0d98336 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:13.389788 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed7d0878-d50c-4a34-8da9-6e97f0d98336 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:13.524359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ed7d0878-d50c-4a34-8da9-6e97f0d98336 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:13.530703 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ed7d0878-d50c-4a34-8da9-6e97f0d98336 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.154821 Aug 10 23:19:13.531268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 255/517] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:13 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:14.550387 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c39dc643-f21f-4234-a61a-fed8a159a86f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:14.551090 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c39dc643-f21f-4234-a61a-fed8a159a86f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:14.557766 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c39dc643-f21f-4234-a61a-fed8a159a86f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:14.561924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c39dc643-f21f-4234-a61a-fed8a159a86f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:14.561924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c39dc643-f21f-4234-a61a-fed8a159a86f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:14.561924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c39dc643-f21f-4234-a61a-fed8a159a86f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:14.561924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c39dc643-f21f-4234-a61a-fed8a159a86f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:14.562357 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c39dc643-f21f-4234-a61a-fed8a159a86f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:14.691375 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c39dc643-f21f-4234-a61a-fed8a159a86f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:14.699262 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c39dc643-f21f-4234-a61a-fed8a159a86f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.152911 Aug 10 23:19:14.699823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 263/518] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:14 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:15.720251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2e001c17-3c9b-405c-a04c-ab232254f5ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:15.720865 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2e001c17-3c9b-405c-a04c-ab232254f5ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:15.728178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2e001c17-3c9b-405c-a04c-ab232254f5ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:15.728655 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2e001c17-3c9b-405c-a04c-ab232254f5ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:15.729090 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2e001c17-3c9b-405c-a04c-ab232254f5ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:15.729779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2e001c17-3c9b-405c-a04c-ab232254f5ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:15.730271 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2e001c17-3c9b-405c-a04c-ab232254f5ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:15.730714 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2e001c17-3c9b-405c-a04c-ab232254f5ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:15.862373 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2e001c17-3c9b-405c-a04c-ab232254f5ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:15.870060 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2e001c17-3c9b-405c-a04c-ab232254f5ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.154001 Aug 10 23:19:15.870634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 256/519] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:15 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:16.311184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-ae178a0b-3e4d-42ce-bc5f-8157b4725fe0 req-87f9b531-3960-407a-945e-36a63c70119f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace5e95d-7b24-4111-ae18-7185b8662c79", "name": "network-vif-plugged", "status": "completed", "tag": "cd7e7501-d9b2-4b2f-9318-8204c144c269"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:16.321602 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-ae178a0b-3e4d-42ce-bc5f-8157b4725fe0 req-87f9b531-3960-407a-945e-36a63c70119f service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.322951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-ae178a0b-3e4d-42ce-bc5f-8157b4725fe0 req-87f9b531-3960-407a-945e-36a63c70119f service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.322951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-ae178a0b-3e4d-42ce-bc5f-8157b4725fe0 req-87f9b531-3960-407a-945e-36a63c70119f service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.333278 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-ae178a0b-3e4d-42ce-bc5f-8157b4725fe0 req-87f9b531-3960-407a-945e-36a63c70119f service nova] Creating event network-vif-plugged:cd7e7501-d9b2-4b2f-9318-8204c144c269 for instance ace5e95d-7b24-4111-ae18-7185b8662c79 on hv-cinder-85144 Aug 10 23:19:16.339246 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-ae178a0b-3e4d-42ce-bc5f-8157b4725fe0 req-87f9b531-3960-407a-945e-36a63c70119f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031600 Aug 10 23:19:16.339857 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 264/520] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:16.890337 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-21d0896b-adc5-421f-91d9-385f6182b4d9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:16.890984 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-21d0896b-adc5-421f-91d9-385f6182b4d9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:16.897497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21d0896b-adc5-421f-91d9-385f6182b4d9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.897995 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21d0896b-adc5-421f-91d9-385f6182b4d9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.898433 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21d0896b-adc5-421f-91d9-385f6182b4d9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.899158 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21d0896b-adc5-421f-91d9-385f6182b4d9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.899618 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21d0896b-adc5-421f-91d9-385f6182b4d9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.900042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21d0896b-adc5-421f-91d9-385f6182b4d9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:17.028783 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-21d0896b-adc5-421f-91d9-385f6182b4d9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:17.036172 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-21d0896b-adc5-421f-91d9-385f6182b4d9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.149745 Aug 10 23:19:17.036740 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 257/521] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:16 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:18.057867 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9fc2e071-f423-4ad0-87e1-ab97f0b7b9e2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:18.058600 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9fc2e071-f423-4ad0-87e1-ab97f0b7b9e2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:18.064741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fc2e071-f423-4ad0-87e1-ab97f0b7b9e2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:18.065225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fc2e071-f423-4ad0-87e1-ab97f0b7b9e2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:18.065663 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fc2e071-f423-4ad0-87e1-ab97f0b7b9e2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:18.066359 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fc2e071-f423-4ad0-87e1-ab97f0b7b9e2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:18.066852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fc2e071-f423-4ad0-87e1-ab97f0b7b9e2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:18.067285 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fc2e071-f423-4ad0-87e1-ab97f0b7b9e2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:18.199248 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-9fc2e071-f423-4ad0-87e1-ab97f0b7b9e2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:18.209318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9fc2e071-f423-4ad0-87e1-ab97f0b7b9e2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1259 microversion: 2.1 time: 0.156090 Aug 10 23:19:18.212216 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 265/522] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:18 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:19.233389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-bbedd595-e647-4a1c-bf53-2319b1d8eac4 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:19.233995 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-bbedd595-e647-4a1c-bf53-2319b1d8eac4 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:19.240871 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bbedd595-e647-4a1c-bf53-2319b1d8eac4 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:19.241436 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bbedd595-e647-4a1c-bf53-2319b1d8eac4 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:19.241876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bbedd595-e647-4a1c-bf53-2319b1d8eac4 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:19.242597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bbedd595-e647-4a1c-bf53-2319b1d8eac4 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:19.243115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bbedd595-e647-4a1c-bf53-2319b1d8eac4 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:19.243526 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bbedd595-e647-4a1c-bf53-2319b1d8eac4 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:19.380741 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-bbedd595-e647-4a1c-bf53-2319b1d8eac4 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:19.388236 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-bbedd595-e647-4a1c-bf53-2319b1d8eac4 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1442 microversion: 2.1 time: 0.158864 Aug 10 23:19:19.388798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 258/523] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:19 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:19.408410 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e31fabdf-2354-4c5e-aa24-9c1c575fc2dd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:19.409143 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e31fabdf-2354-4c5e-aa24-9c1c575fc2dd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:19.415999 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e31fabdf-2354-4c5e-aa24-9c1c575fc2dd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:19.416473 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e31fabdf-2354-4c5e-aa24-9c1c575fc2dd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:19.416903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e31fabdf-2354-4c5e-aa24-9c1c575fc2dd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:19.417586 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e31fabdf-2354-4c5e-aa24-9c1c575fc2dd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:19.418034 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e31fabdf-2354-4c5e-aa24-9c1c575fc2dd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:19.418451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e31fabdf-2354-4c5e-aa24-9c1c575fc2dd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:19.549838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e31fabdf-2354-4c5e-aa24-9c1c575fc2dd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:19.557524 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e31fabdf-2354-4c5e-aa24-9c1c575fc2dd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1442 microversion: 2.1 time: 0.152893 Aug 10 23:19:19.558099 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 266/524] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:19 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:21.468884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-ad00de35-038b-4392-9f9a-44f016ce7d07 req-b32e476c-fa6d-487d-a0c5-406f2f7dd542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace5e95d-7b24-4111-ae18-7185b8662c79", "tag": "cd7e7501-d9b2-4b2f-9318-8204c144c269"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:21.478991 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-ad00de35-038b-4392-9f9a-44f016ce7d07 req-b32e476c-fa6d-487d-a0c5-406f2f7dd542 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:21.479461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-ad00de35-038b-4392-9f9a-44f016ce7d07 req-b32e476c-fa6d-487d-a0c5-406f2f7dd542 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:21.479925 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-ad00de35-038b-4392-9f9a-44f016ce7d07 req-b32e476c-fa6d-487d-a0c5-406f2f7dd542 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:21.491087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-ad00de35-038b-4392-9f9a-44f016ce7d07 req-b32e476c-fa6d-487d-a0c5-406f2f7dd542 service nova] Creating event network-changed:cd7e7501-d9b2-4b2f-9318-8204c144c269 for instance ace5e95d-7b24-4111-ae18-7185b8662c79 on hv-cinder-85144 Aug 10 23:19:21.496225 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-ad00de35-038b-4392-9f9a-44f016ce7d07 req-b32e476c-fa6d-487d-a0c5-406f2f7dd542 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031490 Aug 10 23:19:21.496892 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 259/525] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:22.733926 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-308cf501-0c6e-428b-b73d-2bbb6f4b1289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:22.734453 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-308cf501-0c6e-428b-b73d-2bbb6f4b1289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:22.740377 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-308cf501-0c6e-428b-b73d-2bbb6f4b1289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:22.740861 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-308cf501-0c6e-428b-b73d-2bbb6f4b1289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:22.741298 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-308cf501-0c6e-428b-b73d-2bbb6f4b1289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:22.741989 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-308cf501-0c6e-428b-b73d-2bbb6f4b1289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:22.742444 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-308cf501-0c6e-428b-b73d-2bbb6f4b1289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:22.742907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-308cf501-0c6e-428b-b73d-2bbb6f4b1289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:22.766404 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-308cf501-0c6e-428b-b73d-2bbb6f4b1289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113/ips" status: 200 len: 149 microversion: 2.1 time: 0.137542 Aug 10 23:19:22.767019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 267/526] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 10 23:19:22 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113/ips => generated 149 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:22.780788 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6277a744-367b-4da8-a2ca-836907c6866e"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:22.783204 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:22.789277 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:22.789758 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:22.790742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:22.791442 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:22.791934 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:22.792365 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:22.871278 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Invalid volume: volume 6277a744-367b-4da8-a2ca-836907c6866e is already attached to instances: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: POST /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113/os-volume_attachments HTTP/1.1 Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 74 Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:19:22.873052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {"volumeAttachment": {"volumeId": "6277a744-367b-4da8-a2ca-836907c6866e"}} Aug 10 23:19:22.874777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Invalid volume: volume 6277a744-367b-4da8-a2ca-836907c6866e is already attached to instances: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'server_id': '574d9d8d-0e53-4ef2-a3b6-098699b20113', 'body': {'volumeAttachment': {'volumeId': '6277a744-367b-4da8-a2ca-836907c6866e'}}} Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6277a744-367b-4da8-a2ca-836907c6866e is already attached to instances: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:22.875825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6277a744-367b-4da8-a2ca-836907c6866e is already attached to instances: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:22.877087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:22.878563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:22.878563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:22.878563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:22.878563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6277a744-367b-4da8-a2ca-836907c6866e is already attached to instances: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d Aug 10 23:19:22.878563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:22.878563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 400 to user: Invalid volume: volume 6277a744-367b-4da8-a2ca-836907c6866e is already attached to instances: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:22.878563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-15cc9346-fca7-408d-8765-3418caf8e813 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098491 Aug 10 23:19:22.878563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 260/527] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:19:22 2022] POST /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:19:22.883533 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ba80e0fe-d71f-48d2-97c5-b9ca5339691c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:22.884050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ba80e0fe-d71f-48d2-97c5-b9ca5339691c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:22.893194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba80e0fe-d71f-48d2-97c5-b9ca5339691c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:22.893194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba80e0fe-d71f-48d2-97c5-b9ca5339691c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:22.893194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba80e0fe-d71f-48d2-97c5-b9ca5339691c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:22.893194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba80e0fe-d71f-48d2-97c5-b9ca5339691c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:22.893591 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba80e0fe-d71f-48d2-97c5-b9ca5339691c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:22.893591 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ba80e0fe-d71f-48d2-97c5-b9ca5339691c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:22.916894 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ba80e0fe-d71f-48d2-97c5-b9ca5339691c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:23.177350 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ba80e0fe-d71f-48d2-97c5-b9ca5339691c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 204 len: 0 microversion: 2.1 time: 0.297302 Aug 10 23:19:23.177853 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 268/528] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:22 2022] DELETE /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:23.186036 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6de4272a-d45a-41f3-8229-c9efa2cdb4eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:23.186672 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6de4272a-d45a-41f3-8229-c9efa2cdb4eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:23.193550 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6de4272a-d45a-41f3-8229-c9efa2cdb4eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:23.194049 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6de4272a-d45a-41f3-8229-c9efa2cdb4eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:23.194476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6de4272a-d45a-41f3-8229-c9efa2cdb4eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:23.195215 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6de4272a-d45a-41f3-8229-c9efa2cdb4eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:23.195672 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6de4272a-d45a-41f3-8229-c9efa2cdb4eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:23.196101 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6de4272a-d45a-41f3-8229-c9efa2cdb4eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:23.326155 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6de4272a-d45a-41f3-8229-c9efa2cdb4eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:23.333694 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6de4272a-d45a-41f3-8229-c9efa2cdb4eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1681 microversion: 2.1 time: 0.151496 Aug 10 23:19:23.334259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 261/529] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:23 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:24.356347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-aa52f4e0-ef47-4b46-8cd0-14d0ca38169e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:24.357047 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-aa52f4e0-ef47-4b46-8cd0-14d0ca38169e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:24.363578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa52f4e0-ef47-4b46-8cd0-14d0ca38169e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:24.364057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa52f4e0-ef47-4b46-8cd0-14d0ca38169e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:24.364489 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa52f4e0-ef47-4b46-8cd0-14d0ca38169e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:24.365183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa52f4e0-ef47-4b46-8cd0-14d0ca38169e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:24.365635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa52f4e0-ef47-4b46-8cd0-14d0ca38169e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:24.366063 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aa52f4e0-ef47-4b46-8cd0-14d0ca38169e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:24.500811 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-aa52f4e0-ef47-4b46-8cd0-14d0ca38169e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:24.508145 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-aa52f4e0-ef47-4b46-8cd0-14d0ca38169e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1681 microversion: 2.1 time: 0.156492 Aug 10 23:19:24.508703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 269/530] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:24 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:25.530000 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-43bad2bf-285d-4ef1-90ea-7147b1ce96b0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:25.530794 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-43bad2bf-285d-4ef1-90ea-7147b1ce96b0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:25.537483 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43bad2bf-285d-4ef1-90ea-7147b1ce96b0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:25.538040 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43bad2bf-285d-4ef1-90ea-7147b1ce96b0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:25.538484 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43bad2bf-285d-4ef1-90ea-7147b1ce96b0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:25.539212 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43bad2bf-285d-4ef1-90ea-7147b1ce96b0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:25.539671 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43bad2bf-285d-4ef1-90ea-7147b1ce96b0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:25.540198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43bad2bf-285d-4ef1-90ea-7147b1ce96b0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:25.720166 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-43bad2bf-285d-4ef1-90ea-7147b1ce96b0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:25.728959 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-43bad2bf-285d-4ef1-90ea-7147b1ce96b0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1681 microversion: 2.1 time: 0.202770 Aug 10 23:19:25.729530 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 262/531] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:25 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:25.991625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-1bdcd8f3-ce20-4c6a-adad-3f58b68bf2c1 req-ca1dec47-7a2a-4e96-92d5-6434cdce2f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574d9d8d-0e53-4ef2-a3b6-098699b20113", "name": "network-vif-deleted", "tag": "435af46b-0cb5-4a55-a9a7-b8e22243257b"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:26.005530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-1bdcd8f3-ce20-4c6a-adad-3f58b68bf2c1 req-ca1dec47-7a2a-4e96-92d5-6434cdce2f32 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:26.006128 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-1bdcd8f3-ce20-4c6a-adad-3f58b68bf2c1 req-ca1dec47-7a2a-4e96-92d5-6434cdce2f32 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:26.006490 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-1bdcd8f3-ce20-4c6a-adad-3f58b68bf2c1 req-ca1dec47-7a2a-4e96-92d5-6434cdce2f32 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:26.018405 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-1bdcd8f3-ce20-4c6a-adad-3f58b68bf2c1 req-ca1dec47-7a2a-4e96-92d5-6434cdce2f32 service nova] Creating event network-vif-deleted:435af46b-0cb5-4a55-a9a7-b8e22243257b for instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 on hv-cinder-85144 Aug 10 23:19:26.023382 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-1bdcd8f3-ce20-4c6a-adad-3f58b68bf2c1 req-ca1dec47-7a2a-4e96-92d5-6434cdce2f32 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035332 Aug 10 23:19:26.024195 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 270/532] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:26.750279 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:26.750952 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:26.757904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:26.758633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:26.759169 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:26.759797 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:26.760259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:26.760717 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:26.801895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:26.802597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:26.804325 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:26.805570 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lazy-loading 'fault' on Instance uuid 574d9d8d-0e53-4ef2-a3b6-098699b20113 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:26.859422 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:26.867901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-435ab435-0415-4a55-9654-40c60fbcb0f6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 200 len: 1331 microversion: 2.1 time: 0.121615 Aug 10 23:19:26.868907 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 263/533] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:26 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:27.892641 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:27.893328 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:27.899965 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:27.900442 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:27.900872 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:27.901553 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:27.901999 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:27.902450 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:27.917969 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 HTTP/1.1 Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:19:27.919594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:19:27.921198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': '574d9d8d-0e53-4ef2-a3b6-098699b20113'} Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:27.922012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:19:27.923254 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:19:27.924352 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:27.924352 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b2b6b3f9-ca02-4f6c-a95d-5514d312727e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 404 len: 111 microversion: 2.1 time: 0.033134 Aug 10 23:19:27.924352 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 271/534] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:27 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:27.929983 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b43557b5-1e93-4e95-8fbb-f13abade283c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '.version_select at 0x7fe8405e5ee0>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:28.013284 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b43557b5-1e93-4e95-8fbb-f13abade283c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1457338765" status: 202 len: 0 microversion: 2.1 time: 0.087119 Aug 10 23:19:28.015309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 264/535] 10.222.0.78 () {58 vars in 1221 bytes} [Wed Aug 10 23:19:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1457338765 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:19:28.878349 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-235cc71a-74c4-4514-8147-9280442381aa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:28.878877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-235cc71a-74c4-4514-8147-9280442381aa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:28.885250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-235cc71a-74c4-4514-8147-9280442381aa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:28.885725 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-235cc71a-74c4-4514-8147-9280442381aa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:28.886189 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-235cc71a-74c4-4514-8147-9280442381aa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:28.886912 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-235cc71a-74c4-4514-8147-9280442381aa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:28.887371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-235cc71a-74c4-4514-8147-9280442381aa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:28.887789 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-235cc71a-74c4-4514-8147-9280442381aa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.007103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-235cc71a-74c4-4514-8147-9280442381aa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lazy-loading 'services' on Instance uuid bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:29.227650 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-235cc71a-74c4-4514-8147-9280442381aa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-volume_attachments/6277a744-367b-4da8-a2ca-836907c6866e" status: 202 len: 0 microversion: 2.1 time: 0.352860 Aug 10 23:19:29.228182 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 272/536] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:19:28 2022] DELETE /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-volume_attachments/6277a744-367b-4da8-a2ca-836907c6866e => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:19:29.237094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-52fb8e19-2c2c-4776-b28b-e4db2f41f973 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:29.239404 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-52fb8e19-2c2c-4776-b28b-e4db2f41f973 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:29.245998 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52fb8e19-2c2c-4776-b28b-e4db2f41f973 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:29.246491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52fb8e19-2c2c-4776-b28b-e4db2f41f973 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.246973 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52fb8e19-2c2c-4776-b28b-e4db2f41f973 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.247684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52fb8e19-2c2c-4776-b28b-e4db2f41f973 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:29.248145 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52fb8e19-2c2c-4776-b28b-e4db2f41f973 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.248578 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52fb8e19-2c2c-4776-b28b-e4db2f41f973 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.277886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-52fb8e19-2c2c-4776-b28b-e4db2f41f973 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045330 Aug 10 23:19:29.278447 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 265/537] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:29 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:30.291410 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3464722e-3bd4-4167-bbe6-22ce3e1a7c98 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:30.293698 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3464722e-3bd4-4167-bbe6-22ce3e1a7c98 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:30.300591 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3464722e-3bd4-4167-bbe6-22ce3e1a7c98 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:30.301081 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3464722e-3bd4-4167-bbe6-22ce3e1a7c98 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:30.302719 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3464722e-3bd4-4167-bbe6-22ce3e1a7c98 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:30.303487 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3464722e-3bd4-4167-bbe6-22ce3e1a7c98 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:30.303968 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3464722e-3bd4-4167-bbe6-22ce3e1a7c98 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:30.304406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3464722e-3bd4-4167-bbe6-22ce3e1a7c98 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:30.334695 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3464722e-3bd4-4167-bbe6-22ce3e1a7c98 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048171 Aug 10 23:19:30.335309 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 273/538] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:30 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:31.347971 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-99bddbd7-1be1-411a-bd60-4cc7e81cf107 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:31.350485 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-99bddbd7-1be1-411a-bd60-4cc7e81cf107 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:31.353506 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:31.361011 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99bddbd7-1be1-411a-bd60-4cc7e81cf107 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.361502 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99bddbd7-1be1-411a-bd60-4cc7e81cf107 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.364138 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99bddbd7-1be1-411a-bd60-4cc7e81cf107 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.364138 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99bddbd7-1be1-411a-bd60-4cc7e81cf107 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.364138 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99bddbd7-1be1-411a-bd60-4cc7e81cf107 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.364138 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-99bddbd7-1be1-411a-bd60-4cc7e81cf107 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.367299 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=90 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:31.395076 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-99bddbd7-1be1-411a-bd60-4cc7e81cf107 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051038 Aug 10 23:19:31.395634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 266/539] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:31 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:19:31.459493 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f17e4a07-654e-48bf-a722-1bfcc43d9289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:31.459985 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f17e4a07-654e-48bf-a722-1bfcc43d9289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:31.466238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f17e4a07-654e-48bf-a722-1bfcc43d9289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.467007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f17e4a07-654e-48bf-a722-1bfcc43d9289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.467435 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f17e4a07-654e-48bf-a722-1bfcc43d9289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.468145 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f17e4a07-654e-48bf-a722-1bfcc43d9289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.468595 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f17e4a07-654e-48bf-a722-1bfcc43d9289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.469011 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f17e4a07-654e-48bf-a722-1bfcc43d9289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.493133 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f17e4a07-654e-48bf-a722-1bfcc43d9289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:31.506755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:31.703225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f17e4a07-654e-48bf-a722-1bfcc43d9289 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 204 len: 0 microversion: 2.1 time: 0.247096 Aug 10 23:19:31.704111 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 274/540] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:31 2022] DELETE /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:31.713087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-51ee3172-db37-4ff2-8168-39133a7fc768 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:31.713698 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-51ee3172-db37-4ff2-8168-39133a7fc768 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:31.720795 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51ee3172-db37-4ff2-8168-39133a7fc768 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.725964 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51ee3172-db37-4ff2-8168-39133a7fc768 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.725964 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51ee3172-db37-4ff2-8168-39133a7fc768 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.725964 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51ee3172-db37-4ff2-8168-39133a7fc768 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.725964 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51ee3172-db37-4ff2-8168-39133a7fc768 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.726356 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51ee3172-db37-4ff2-8168-39133a7fc768 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.858387 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-51ee3172-db37-4ff2-8168-39133a7fc768 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:31.865874 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-51ee3172-db37-4ff2-8168-39133a7fc768 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1682 microversion: 2.1 time: 0.157403 Aug 10 23:19:31.866437 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 267/541] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:31 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:32.887960 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b463a96a-2be1-4f5c-ad7e-05d1979b1fb6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:32.888686 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b463a96a-2be1-4f5c-ad7e-05d1979b1fb6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:32.894910 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b463a96a-2be1-4f5c-ad7e-05d1979b1fb6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:32.895391 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b463a96a-2be1-4f5c-ad7e-05d1979b1fb6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:32.895826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b463a96a-2be1-4f5c-ad7e-05d1979b1fb6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:32.896518 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b463a96a-2be1-4f5c-ad7e-05d1979b1fb6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:32.897006 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b463a96a-2be1-4f5c-ad7e-05d1979b1fb6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:32.897431 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b463a96a-2be1-4f5c-ad7e-05d1979b1fb6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:33.128773 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b463a96a-2be1-4f5c-ad7e-05d1979b1fb6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:33.136204 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b463a96a-2be1-4f5c-ad7e-05d1979b1fb6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1682 microversion: 2.1 time: 0.252388 Aug 10 23:19:33.136933 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 275/542] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:32 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:33.689854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-25463202-bcf8-4169-8028-9257957fc106 req-556c7d04-6bb8-4391-875b-6460de9d0d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d", "name": "network-vif-deleted", "tag": "c83fa2ce-f061-4547-9cb4-a740a906feac"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:33.699644 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-25463202-bcf8-4169-8028-9257957fc106 req-556c7d04-6bb8-4391-875b-6460de9d0d73 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:33.701294 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-25463202-bcf8-4169-8028-9257957fc106 req-556c7d04-6bb8-4391-875b-6460de9d0d73 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:33.701294 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-25463202-bcf8-4169-8028-9257957fc106 req-556c7d04-6bb8-4391-875b-6460de9d0d73 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:33.711667 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-25463202-bcf8-4169-8028-9257957fc106 req-556c7d04-6bb8-4391-875b-6460de9d0d73 service nova] Creating event network-vif-deleted:c83fa2ce-f061-4547-9cb4-a740a906feac for instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d on hv-cinder-85144 Aug 10 23:19:33.717679 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-25463202-bcf8-4169-8028-9257957fc106 req-556c7d04-6bb8-4391-875b-6460de9d0d73 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032314 Aug 10 23:19:33.718305 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 268/543] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:34.157486 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:34.158006 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:34.160389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:34.164992 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:34.165477 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:34.165948 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:34.166637 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:34.167263 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:34.167697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:34.199005 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:34.199474 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:34.199905 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:34.200348 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lazy-loading 'fault' on Instance uuid bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:34.244464 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:34.252189 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0fccc07f-9c78-4f48-baaf-26e408b713b3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 200 len: 1331 microversion: 2.1 time: 0.098593 Aug 10 23:19:34.252757 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 276/544] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:34 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:35.275389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:35.276092 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:35.282268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.282786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.283232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.283930 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.284389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.284817 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.297689 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d HTTP/1.1 Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:19:35.299423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:19:35.300966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d'} Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:35.301862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:19:35.303348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:35.304658 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:35.304658 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-33458732-5cfd-4d5d-b1ec-7e5e8846db0b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 404 len: 111 microversion: 2.1 time: 0.030835 Aug 10 23:19:35.304658 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 269/545] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:35 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:35.311118 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1e3676e5-48e7-4a17-b6fc-843632491525 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '.version_select at 0x7fe833e539d0>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:35.383945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1e3676e5-48e7-4a17-b6fc-843632491525 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-255779325" status: 202 len: 0 microversion: 2.1 time: 0.077416 Aug 10 23:19:35.385217 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 277/546] 10.222.0.78 () {58 vars in 1218 bytes} [Wed Aug 10 23:19:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-255779325 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:19:35.467547 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e9eefdcb-c104-412d-940e-f7a8f6f380f8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:35.468133 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e9eefdcb-c104-412d-940e-f7a8f6f380f8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:35.474038 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9eefdcb-c104-412d-940e-f7a8f6f380f8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.474520 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9eefdcb-c104-412d-940e-f7a8f6f380f8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.474992 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9eefdcb-c104-412d-940e-f7a8f6f380f8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.475697 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9eefdcb-c104-412d-940e-f7a8f6f380f8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.476159 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9eefdcb-c104-412d-940e-f7a8f6f380f8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.476585 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e9eefdcb-c104-412d-940e-f7a8f6f380f8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.505450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e9eefdcb-c104-412d-940e-f7a8f6f380f8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-volume_attachments/cf8ea20a-a413-414b-8637-3c45fcf77592" status: 200 len: 194 microversion: 2.20 time: 0.155474 Aug 10 23:19:35.506502 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 270/547] 10.222.0.78 () {60 vars in 1454 bytes} [Wed Aug 10 23:19:35 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-volume_attachments/cf8ea20a-a413-414b-8637-3c45fcf77592 => generated 194 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:19:35.573832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fb4a79fb-bfbc-48d0-8fb1-6ff223266ada tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:35.587128 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-fb4a79fb-bfbc-48d0-8fb1-6ff223266ada tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:35.587128 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb4a79fb-bfbc-48d0-8fb1-6ff223266ada tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.587128 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb4a79fb-bfbc-48d0-8fb1-6ff223266ada tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.587128 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb4a79fb-bfbc-48d0-8fb1-6ff223266ada tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.588040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb4a79fb-bfbc-48d0-8fb1-6ff223266ada tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.588040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb4a79fb-bfbc-48d0-8fb1-6ff223266ada tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.588040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb4a79fb-bfbc-48d0-8fb1-6ff223266ada tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.688081 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-fb4a79fb-bfbc-48d0-8fb1-6ff223266ada tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lazy-loading 'services' on Instance uuid d062824b-f7a6-4380-a622-5bba74816355 {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:35.907900 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-fb4a79fb-bfbc-48d0-8fb1-6ff223266ada tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-volume_attachments/cf8ea20a-a413-414b-8637-3c45fcf77592" status: 202 len: 0 microversion: 2.20 time: 0.337835 Aug 10 23:19:35.909048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 278/548] 10.222.0.78 () {60 vars in 1457 bytes} [Wed Aug 10 23:19:35 2022] DELETE /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-volume_attachments/cf8ea20a-a413-414b-8637-3c45fcf77592 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:35.917355 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-16fe0e54-9a9c-41b4-a681-853e3798a7c5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:35.919891 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-16fe0e54-9a9c-41b4-a681-853e3798a7c5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:35.925910 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16fe0e54-9a9c-41b4-a681-853e3798a7c5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.926465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16fe0e54-9a9c-41b4-a681-853e3798a7c5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.927001 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16fe0e54-9a9c-41b4-a681-853e3798a7c5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.927816 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16fe0e54-9a9c-41b4-a681-853e3798a7c5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.928359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16fe0e54-9a9c-41b4-a681-853e3798a7c5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.928880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16fe0e54-9a9c-41b4-a681-853e3798a7c5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.960494 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-16fe0e54-9a9c-41b4-a681-853e3798a7c5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047091 Aug 10 23:19:35.961047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 271/549] 10.222.0.78 () {60 vars in 1343 bytes} [Wed Aug 10 23:19:35 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:19:36.215012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8ee2e3e0-c6a1-456d-8643-b06e90a8a46e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: .version_select at 0x7fe833e7dee0>, body: {"keypair": {"name": "tempest-keypair-1514564441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5umR29UCvJf/+o5b1sHBgFwGOOFkVFl5bBX2PFiUrpxJbwp+PC9gyeRV42AXFHj6KY/AAM6G259zkfIFkFf7Bil0MjP2HKI36d3LbPtIWCYTdm/1e4AH+8+V2wPPQxqg=="}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:36.231120 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-8ee2e3e0-c6a1-456d-8643-b06e90a8a46e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:36.235044 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-8ee2e3e0-c6a1-456d-8643-b06e90a8a46e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for user 22e92975af1d439f88e33cc494c88b1f and project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:36.321132 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8ee2e3e0-c6a1-456d-8643-b06e90a8a46e tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110445 Aug 10 23:19:36.321760 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 279/550] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 10 23:19:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:36.973548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9b983d17-2054-45a8-89b0-c082004d5400 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:36.977850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9b983d17-2054-45a8-89b0-c082004d5400 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:36.982848 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b983d17-2054-45a8-89b0-c082004d5400 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.983336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b983d17-2054-45a8-89b0-c082004d5400 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.983820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b983d17-2054-45a8-89b0-c082004d5400 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.984512 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b983d17-2054-45a8-89b0-c082004d5400 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.984967 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b983d17-2054-45a8-89b0-c082004d5400 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.985398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b983d17-2054-45a8-89b0-c082004d5400 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.017162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9b983d17-2054-45a8-89b0-c082004d5400 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047694 Aug 10 23:19:37.017765 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 272/551] 10.222.0.78 () {60 vars in 1343 bytes} [Wed Aug 10 23:19:36 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:37.084200 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-26d4b8bd-9e6e-4470-89fd-4f56d0db52ce tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:37.085155 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-26d4b8bd-9e6e-4470-89fd-4f56d0db52ce tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:37.093091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26d4b8bd-9e6e-4470-89fd-4f56d0db52ce tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.093576 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26d4b8bd-9e6e-4470-89fd-4f56d0db52ce tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.098846 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26d4b8bd-9e6e-4470-89fd-4f56d0db52ce tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.098846 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26d4b8bd-9e6e-4470-89fd-4f56d0db52ce tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.098846 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26d4b8bd-9e6e-4470-89fd-4f56d0db52ce tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.098846 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26d4b8bd-9e6e-4470-89fd-4f56d0db52ce tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.122226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-26d4b8bd-9e6e-4470-89fd-4f56d0db52ce tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:37.428626 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-26d4b8bd-9e6e-4470-89fd-4f56d0db52ce tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 204 len: 0 microversion: 2.20 time: 0.348119 Aug 10 23:19:37.429669 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 280/552] 10.222.0.78 () {60 vars in 1280 bytes} [Wed Aug 10 23:19:37 2022] DELETE /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:19:37.438418 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:37.439048 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:37.445047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.445524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.445955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.446647 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.447131 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.447549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.583469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:37.592970 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:37.594482 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:37.595674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-64540f2b-1390-4a9e-979f-cd75b73ceb23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.161682 Aug 10 23:19:37.596228 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 273/553] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:37 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:38.469149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1099897900", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ce4c9a7-fd4e-4da4-add0-101e1cd65acd"}], "security_groups": [{"name": "tempest-securitygroup--581470587"}], "key_name": "tempest-keypair-1514564441", "user_data": "}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:38.575498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.network.neutron [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] validate_networks() for [('5ce4c9a7-fd4e-4da4-add0-101e1cd65acd', None, None, None, None, None)] {{(pid=121332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:19:38.620525 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:38.621131 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:38.627677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:38.628183 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:38.628611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:38.629321 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:38.629778 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:38.630209 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:38.819822 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:38.828441 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:38.830009 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:38.831213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3cd0cb50-228d-49c4-b4ce-d40efb0a10e5 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.214720 Aug 10 23:19:38.831775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 274/554] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:38 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:19:39.059354 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Flavor limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:19:39.059781 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Image limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:19:39.060256 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Flavor pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:19:39.060697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Image pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:19:39.061114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:19:39.069896 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:39.070318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:39.070798 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:39.071538 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:39.072560 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:39.072993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:39.092280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:39.096223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for user 22e92975af1d439f88e33cc494c88b1f and project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:39.107105 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Going to run 1 instances... {{(pid=121332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:19:39.110389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:19:39.275519 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-79307f01-9ca5-4ce7-8e16-586ed31d179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.811336 Aug 10 23:19:39.276371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 281/555] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:19:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:19:39.287574 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4d69889c-2048-43d4-a618-0d5803219877 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:39.288197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4d69889c-2048-43d4-a618-0d5803219877 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:39.342602 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4d69889c-2048-43d4-a618-0d5803219877 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:39.349849 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4d69889c-2048-43d4-a618-0d5803219877 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1242 microversion: 2.1 time: 0.066828 Aug 10 23:19:39.350431 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 275/556] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:39 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:39.855922 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:39.856536 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:39.862537 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:39.863060 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:39.863494 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:39.864241 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:39.864694 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:39.865230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.047050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:40.054949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:40.057098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:40.058238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-67b9595c-a3ce-4651-a547-b87e8c557602 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1724 microversion: 2.20 time: 0.206917 Aug 10 23:19:40.058862 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 282/557] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:39 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:40.371236 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-289b74a6-f4bd-461d-ba63-579506a24d53 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:40.371857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-289b74a6-f4bd-461d-ba63-579506a24d53 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:40.378984 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-289b74a6-f4bd-461d-ba63-579506a24d53 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.383620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-289b74a6-f4bd-461d-ba63-579506a24d53 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.383620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-289b74a6-f4bd-461d-ba63-579506a24d53 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.383620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-289b74a6-f4bd-461d-ba63-579506a24d53 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.383620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-289b74a6-f4bd-461d-ba63-579506a24d53 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.384419 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-289b74a6-f4bd-461d-ba63-579506a24d53 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.458498 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-289b74a6-f4bd-461d-ba63-579506a24d53 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:40.470677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-289b74a6-f4bd-461d-ba63-579506a24d53 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1246 microversion: 2.1 time: 0.103927 Aug 10 23:19:40.472016 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 276/558] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:40 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:40.556847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-15d30984-04cb-4e74-aaf9-ca628738c079 req-66b00865-c0a3-4bf9-a2ee-15165d0c8f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d062824b-f7a6-4380-a622-5bba74816355", "name": "network-vif-deleted", "tag": "6056ee81-d58a-4644-a5ae-8077d23b8e92"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:40.567438 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-15d30984-04cb-4e74-aaf9-ca628738c079 req-66b00865-c0a3-4bf9-a2ee-15165d0c8f78 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.568403 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-15d30984-04cb-4e74-aaf9-ca628738c079 req-66b00865-c0a3-4bf9-a2ee-15165d0c8f78 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.569080 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-15d30984-04cb-4e74-aaf9-ca628738c079 req-66b00865-c0a3-4bf9-a2ee-15165d0c8f78 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.584261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-15d30984-04cb-4e74-aaf9-ca628738c079 req-66b00865-c0a3-4bf9-a2ee-15165d0c8f78 service nova] Creating event network-vif-deleted:6056ee81-d58a-4644-a5ae-8077d23b8e92 for instance d062824b-f7a6-4380-a622-5bba74816355 on hv-cinder-85144 Aug 10 23:19:40.589863 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-15d30984-04cb-4e74-aaf9-ca628738c079 req-66b00865-c0a3-4bf9-a2ee-15165d0c8f78 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038285 Aug 10 23:19:40.595525 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 283/559] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:41.081421 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:41.082047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:41.089271 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.089768 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.090214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.090969 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.091691 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.092125 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.128748 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.129241 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.129684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.130145 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lazy-loading 'fault' on Instance uuid d062824b-f7a6-4380-a622-5bba74816355 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:41.173749 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:41.181658 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:41.183211 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:41.184364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f80f9111-2bb2-4a27-a36f-2b07f56f4b7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 200 len: 1372 microversion: 2.20 time: 0.106951 Aug 10 23:19:41.184929 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 277/560] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:41 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:41.495951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-df5abc8d-cfa6-4085-8c26-bc76be4db142 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:41.499091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-df5abc8d-cfa6-4085-8c26-bc76be4db142 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:41.518911 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df5abc8d-cfa6-4085-8c26-bc76be4db142 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.519406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df5abc8d-cfa6-4085-8c26-bc76be4db142 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.519847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df5abc8d-cfa6-4085-8c26-bc76be4db142 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.520563 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df5abc8d-cfa6-4085-8c26-bc76be4db142 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.521082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df5abc8d-cfa6-4085-8c26-bc76be4db142 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.521711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-df5abc8d-cfa6-4085-8c26-bc76be4db142 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.630686 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-df5abc8d-cfa6-4085-8c26-bc76be4db142 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:41.639635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-df5abc8d-cfa6-4085-8c26-bc76be4db142 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1302 microversion: 2.1 time: 0.150609 Aug 10 23:19:41.654059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 284/561] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:41 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1302 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:42.206799 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:42.207555 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:42.214834 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.218770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.218770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.218770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.218770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.219212 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.237215 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] HTTP exception thrown: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Request method failure captured: Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 HTTP/1.1 Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9Duce-5IGmVZgqON83VaiwvoiGtAKOT-sCTaPajSQKIvCM62_1rHQ52C0hSTpZptwCu239_zyUTmXMIsfNW9pOV9hKrM_Zgr_ovZYsuFJKy6Dtq9XdrVs3BJ3BATYGbUBPW5grjJvPik3tEXRB8Ao0G0Yamf2A5FSSG3oi_YWgVaoH4 Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:19:42.241696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_830b226057d740ca85bbdde6c1a5dca8", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 45dd5b35a039468d99ec0d393056c5af Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:19:42.243309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'd062824b-f7a6-4380-a622-5bba74816355'} Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:42.244110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:19:42.245532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:19:42.246846 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Returning 404 to user: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:42.246846 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-91ee0a0d-4f85-4e68-8cfb-f001cf0760e4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 404 len: 111 microversion: 2.20 time: 0.037420 Aug 10 23:19:42.246846 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 278/562] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:42 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:19:42.250298 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-55ce1d94-7edd-4e2f-9d01-ebea2f828224 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '.version_select at 0x7fe833fe6af0>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:42.349890 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-55ce1d94-7edd-4e2f-9d01-ebea2f828224 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612192330" status: 204 len: 0 microversion: 2.20 time: 0.103163 Aug 10 23:19:42.350483 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 285/563] 10.222.0.78 () {60 vars in 1262 bytes} [Wed Aug 10 23:19:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612192330 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 23:19:42.662142 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1582af9f-6350-477b-8a98-6577183bd135 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:42.667804 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1582af9f-6350-477b-8a98-6577183bd135 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:42.670314 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1582af9f-6350-477b-8a98-6577183bd135 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.670962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1582af9f-6350-477b-8a98-6577183bd135 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.671497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1582af9f-6350-477b-8a98-6577183bd135 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.672184 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1582af9f-6350-477b-8a98-6577183bd135 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.672642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1582af9f-6350-477b-8a98-6577183bd135 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.673072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1582af9f-6350-477b-8a98-6577183bd135 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.024266 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1582af9f-6350-477b-8a98-6577183bd135 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:43.031975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1582af9f-6350-477b-8a98-6577183bd135 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.374208 Aug 10 23:19:43.032552 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 279/564] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:42 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:43.605504 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4d889c73-900f-4ab2-a575-8232561f326b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Action: 'create', calling method: .version_select at 0x7fe833dae790>, body: {"keypair": {"name": "tempest-keypair-1747588682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5gJ9kdLWon2tlpwJCoiBSwSl+QCvchZ2ziP8yeF1sVPIvUoAxD20oP3hwysHcVDDM1RcsjXXhaZnWX85QmSuAFd8cc6hokq1XAzTwh91oQHX1S7umErEW9X+3pSLRPFg=="}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:43.621436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-4d889c73-900f-4ab2-a575-8232561f326b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Getting quotas for project 830b226057d740ca85bbdde6c1a5dca8. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:43.625237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-4d889c73-900f-4ab2-a575-8232561f326b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Getting quotas for user 45dd5b35a039468d99ec0d393056c5af and project 830b226057d740ca85bbdde6c1a5dca8. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:43.711437 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4d889c73-900f-4ab2-a575-8232561f326b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.110473 Aug 10 23:19:43.712904 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 286/565] 10.222.0.78 () {62 vars in 1200 bytes} [Wed Aug 10 23:19:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 23:19:43.834008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-578912ac-dec5-492a-9d36-a4eb9fcbe9d2 req-2251216d-29e0-43c1-8c02-41896383220a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54661f9-1a04-4076-9cad-bbef28ed6e3d", "tag": "1c047fed-fd6b-486e-865f-6dd6859da484"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:43.850674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-578912ac-dec5-492a-9d36-a4eb9fcbe9d2 req-2251216d-29e0-43c1-8c02-41896383220a service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.850674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-578912ac-dec5-492a-9d36-a4eb9fcbe9d2 req-2251216d-29e0-43c1-8c02-41896383220a service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.850674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-578912ac-dec5-492a-9d36-a4eb9fcbe9d2 req-2251216d-29e0-43c1-8c02-41896383220a service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.858067 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-578912ac-dec5-492a-9d36-a4eb9fcbe9d2 req-2251216d-29e0-43c1-8c02-41896383220a service nova] Creating event network-changed:1c047fed-fd6b-486e-865f-6dd6859da484 for instance b54661f9-1a04-4076-9cad-bbef28ed6e3d on hv-cinder-85144 Aug 10 23:19:43.863320 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-578912ac-dec5-492a-9d36-a4eb9fcbe9d2 req-2251216d-29e0-43c1-8c02-41896383220a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033322 Aug 10 23:19:43.864035 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 280/566] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:44.053446 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-23e9cfe9-7ce5-4778-a9bd-3427c462179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:44.054065 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-23e9cfe9-7ce5-4778-a9bd-3427c462179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:44.060369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23e9cfe9-7ce5-4778-a9bd-3427c462179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:44.061062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23e9cfe9-7ce5-4778-a9bd-3427c462179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:44.061666 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23e9cfe9-7ce5-4778-a9bd-3427c462179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:44.062834 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23e9cfe9-7ce5-4778-a9bd-3427c462179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:44.068702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23e9cfe9-7ce5-4778-a9bd-3427c462179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:44.068702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23e9cfe9-7ce5-4778-a9bd-3427c462179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:44.241065 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-23e9cfe9-7ce5-4778-a9bd-3427c462179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:44.249073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-23e9cfe9-7ce5-4778-a9bd-3427c462179f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.199381 Aug 10 23:19:44.250263 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 287/567] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:44 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:45.271833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d35c6bcf-c24d-423d-a3c1-9d082f644572 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:45.272535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d35c6bcf-c24d-423d-a3c1-9d082f644572 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:45.279363 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d35c6bcf-c24d-423d-a3c1-9d082f644572 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.281216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d35c6bcf-c24d-423d-a3c1-9d082f644572 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.281216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d35c6bcf-c24d-423d-a3c1-9d082f644572 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.281216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d35c6bcf-c24d-423d-a3c1-9d082f644572 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.281523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d35c6bcf-c24d-423d-a3c1-9d082f644572 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.281802 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d35c6bcf-c24d-423d-a3c1-9d082f644572 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.486264 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d35c6bcf-c24d-423d-a3c1-9d082f644572 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:45.493989 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d35c6bcf-c24d-423d-a3c1-9d082f644572 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.226873 Aug 10 23:19:45.498284 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 281/568] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:45 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:46.377154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1881722095", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5706bed-5eba-416c-a716-3d6de0641407"}], "security_groups": [{"name": "tempest-securitygroup--1676499875"}], "key_name": "tempest-keypair-1747588682", "user_data": "}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:46.515057 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-74d19131-c340-4a44-bd5e-fc67f6a818d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:46.515663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-74d19131-c340-4a44-bd5e-fc67f6a818d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:46.522329 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-74d19131-c340-4a44-bd5e-fc67f6a818d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:46.522861 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-74d19131-c340-4a44-bd5e-fc67f6a818d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:46.523301 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-74d19131-c340-4a44-bd5e-fc67f6a818d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:46.524010 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-74d19131-c340-4a44-bd5e-fc67f6a818d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:46.524471 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-74d19131-c340-4a44-bd5e-fc67f6a818d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:46.524897 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-74d19131-c340-4a44-bd5e-fc67f6a818d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:46.774237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.network.neutron [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] validate_networks() for [('f5706bed-5eba-416c-a716-3d6de0641407', None, None, None, None, None)] {{(pid=121332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:19:46.877375 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-74d19131-c340-4a44-bd5e-fc67f6a818d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:46.887752 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-74d19131-c340-4a44-bd5e-fc67f6a818d4 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.373780 Aug 10 23:19:46.887752 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 282/569] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:46 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:47.182325 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Flavor limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:19:47.182788 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Image limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:19:47.183264 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Flavor pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:19:47.183725 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Image pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:19:47.184135 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:19:47.192834 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.193308 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.193737 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:47.194455 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.194925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.195343 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:47.211448 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Getting quotas for project 830b226057d740ca85bbdde6c1a5dca8. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:47.215866 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Getting quotas for user 45dd5b35a039468d99ec0d393056c5af and project 830b226057d740ca85bbdde6c1a5dca8. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:47.226754 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Going to run 1 instances... {{(pid=121332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:19:47.229560 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:19:47.402634 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5c4f4411-0457-459c-99f3-4a129b820d41 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.030698 Aug 10 23:19:47.406723 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 288/570] 10.222.0.78 () {62 vars in 1188 bytes} [Wed Aug 10 23:19:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:19:47.414132 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-15e549ab-49cd-4637-a9bc-0bc47338114b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:47.416056 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-15e549ab-49cd-4637-a9bc-0bc47338114b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:47.471989 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-15e549ab-49cd-4637-a9bc-0bc47338114b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:47.479172 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-15e549ab-49cd-4637-a9bc-0bc47338114b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:47.480693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-15e549ab-49cd-4637-a9bc-0bc47338114b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:47.481931 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-15e549ab-49cd-4637-a9bc-0bc47338114b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1282 microversion: 2.20 time: 0.071503 Aug 10 23:19:47.482392 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 283/571] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:47 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:47.906057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-48291fae-8523-4b80-9a85-742ea620e53a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:47.906827 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-48291fae-8523-4b80-9a85-742ea620e53a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:47.913583 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48291fae-8523-4b80-9a85-742ea620e53a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.914140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48291fae-8523-4b80-9a85-742ea620e53a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.914644 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48291fae-8523-4b80-9a85-742ea620e53a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:47.915544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48291fae-8523-4b80-9a85-742ea620e53a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.916138 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48291fae-8523-4b80-9a85-742ea620e53a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.916608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48291fae-8523-4b80-9a85-742ea620e53a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.050744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-48291fae-8523-4b80-9a85-742ea620e53a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:48.058681 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-48291fae-8523-4b80-9a85-742ea620e53a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.157068 Aug 10 23:19:48.059248 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 289/572] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:47 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:48.504230 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:48.505033 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:48.514149 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:48.514560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:48.515055 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.515765 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:48.516251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:48.516707 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.582682 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:48.591629 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:48.593153 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:48.594253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2901d8a9-542b-442a-aef8-5d22ba0bde80 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1278 microversion: 2.20 time: 0.094102 Aug 10 23:19:48.594861 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 284/573] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:48 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:49.079159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-369e60d9-2cb8-45cb-baf6-f49185ad50ad tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:49.079782 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-369e60d9-2cb8-45cb-baf6-f49185ad50ad tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:49.086111 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-369e60d9-2cb8-45cb-baf6-f49185ad50ad tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.086597 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-369e60d9-2cb8-45cb-baf6-f49185ad50ad tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.087068 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-369e60d9-2cb8-45cb-baf6-f49185ad50ad tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.087770 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-369e60d9-2cb8-45cb-baf6-f49185ad50ad tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.088265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-369e60d9-2cb8-45cb-baf6-f49185ad50ad tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.088698 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-369e60d9-2cb8-45cb-baf6-f49185ad50ad tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.240459 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-369e60d9-2cb8-45cb-baf6-f49185ad50ad tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:49.249180 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-369e60d9-2cb8-45cb-baf6-f49185ad50ad tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.173401 Aug 10 23:19:49.252952 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 290/574] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:49 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:49.253096 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9d80cd74-c2a1-435a-bd7d-c30212ef771a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:49.253096 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9d80cd74-c2a1-435a-bd7d-c30212ef771a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:49.258963 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d80cd74-c2a1-435a-bd7d-c30212ef771a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.259450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d80cd74-c2a1-435a-bd7d-c30212ef771a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.259922 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d80cd74-c2a1-435a-bd7d-c30212ef771a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.260628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d80cd74-c2a1-435a-bd7d-c30212ef771a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.261086 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d80cd74-c2a1-435a-bd7d-c30212ef771a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.261517 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d80cd74-c2a1-435a-bd7d-c30212ef771a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.346773 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-9d80cd74-c2a1-435a-bd7d-c30212ef771a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lazy-loading 'services' on Instance uuid f942a5b6-08d7-4d52-a7bd-1af4aaba1930 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:49.594060 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9d80cd74-c2a1-435a-bd7d-c30212ef771a tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments/660d91c8-9ea6-4e69-b0ca-0e33893af524" status: 202 len: 0 microversion: 2.1 time: 0.345508 Aug 10 23:19:49.594729 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 285/575] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:19:49 2022] DELETE /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments/660d91c8-9ea6-4e69-b0ca-0e33893af524 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:19:49.604736 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-15c9bc13-c5c2-421d-8293-8fc81f4ecc7d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:49.609251 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-15c9bc13-c5c2-421d-8293-8fc81f4ecc7d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:49.618099 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:49.618757 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15c9bc13-c5c2-421d-8293-8fc81f4ecc7d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.618893 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:49.619601 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15c9bc13-c5c2-421d-8293-8fc81f4ecc7d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.620863 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15c9bc13-c5c2-421d-8293-8fc81f4ecc7d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.622416 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15c9bc13-c5c2-421d-8293-8fc81f4ecc7d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.623348 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15c9bc13-c5c2-421d-8293-8fc81f4ecc7d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.629560 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15c9bc13-c5c2-421d-8293-8fc81f4ecc7d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.629714 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.629714 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.629714 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.629714 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.630115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.630115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.645471 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:49.663706 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-15c9bc13-c5c2-421d-8293-8fc81f4ecc7d tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064527 Aug 10 23:19:49.664265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 291/576] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:49 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:49.714862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:49.725221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:49.727691 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:49.729207 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-63b1b008-7dce-4da4-a3ff-afa6d779c8fb tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1352 microversion: 2.20 time: 0.116311 Aug 10 23:19:49.730243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 286/577] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:49 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:50.271329 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-dc37080d-299a-4d93-a83f-1f071d40e819 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:50.272064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-dc37080d-299a-4d93-a83f-1f071d40e819 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:50.279985 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc37080d-299a-4d93-a83f-1f071d40e819 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.279985 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc37080d-299a-4d93-a83f-1f071d40e819 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.280362 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc37080d-299a-4d93-a83f-1f071d40e819 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.281263 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc37080d-299a-4d93-a83f-1f071d40e819 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.281713 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc37080d-299a-4d93-a83f-1f071d40e819 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.282136 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dc37080d-299a-4d93-a83f-1f071d40e819 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.511773 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-dc37080d-299a-4d93-a83f-1f071d40e819 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:50.523656 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-dc37080d-299a-4d93-a83f-1f071d40e819 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.256080 Aug 10 23:19:50.538646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 292/578] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:50 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:50.639975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-bd11e19f-6940-477d-abff-1571ab2cacc2 req-c8a7530d-577c-4381-9afa-67e2d3424ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54661f9-1a04-4076-9cad-bbef28ed6e3d", "name": "network-vif-plugged", "status": "completed", "tag": "1c047fed-fd6b-486e-865f-6dd6859da484"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:50.651117 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-bd11e19f-6940-477d-abff-1571ab2cacc2 req-c8a7530d-577c-4381-9afa-67e2d3424ce4 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.651829 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-bd11e19f-6940-477d-abff-1571ab2cacc2 req-c8a7530d-577c-4381-9afa-67e2d3424ce4 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.652270 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-bd11e19f-6940-477d-abff-1571ab2cacc2 req-c8a7530d-577c-4381-9afa-67e2d3424ce4 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.663603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-bd11e19f-6940-477d-abff-1571ab2cacc2 req-c8a7530d-577c-4381-9afa-67e2d3424ce4 service nova] Creating event network-vif-plugged:1c047fed-fd6b-486e-865f-6dd6859da484 for instance b54661f9-1a04-4076-9cad-bbef28ed6e3d on hv-cinder-85144 Aug 10 23:19:50.668423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-bd11e19f-6940-477d-abff-1571ab2cacc2 req-c8a7530d-577c-4381-9afa-67e2d3424ce4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090577 Aug 10 23:19:50.669529 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 287/579] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:19:50.676352 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-80d02672-df94-4401-af60-c17a601fb809 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:50.678725 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-80d02672-df94-4401-af60-c17a601fb809 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:50.686265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-80d02672-df94-4401-af60-c17a601fb809 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.687357 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-80d02672-df94-4401-af60-c17a601fb809 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.687985 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-80d02672-df94-4401-af60-c17a601fb809 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.689200 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-80d02672-df94-4401-af60-c17a601fb809 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.689964 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-80d02672-df94-4401-af60-c17a601fb809 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.690552 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-80d02672-df94-4401-af60-c17a601fb809 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.714694 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:50.730015 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-80d02672-df94-4401-af60-c17a601fb809 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057767 Aug 10 23:19:50.731338 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 293/580] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:50 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:50.756873 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:50.763211 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:50.766217 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.766742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.767190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.767937 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.768402 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.768898 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.965461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:50.974202 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:50.975782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:50.976920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-50525473-ebd9-4632-b52a-1cab8f42638e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.225452 Aug 10 23:19:50.977473 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 288/581] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:50 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:51.290637 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-e9ebe374-f825-4fa6-9884-1b00179fdc96 req-7dd218e9-0885-4514-8e7f-fb5f7cbba590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40168342-ce20-4df4-9112-60c03c657239", "tag": "33300b87-970b-4a82-b42e-51c6998b535a"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:51.300876 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:51.301943 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-e9ebe374-f825-4fa6-9884-1b00179fdc96 req-7dd218e9-0885-4514-8e7f-fb5f7cbba590 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.302418 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-e9ebe374-f825-4fa6-9884-1b00179fdc96 req-7dd218e9-0885-4514-8e7f-fb5f7cbba590 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.302876 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-e9ebe374-f825-4fa6-9884-1b00179fdc96 req-7dd218e9-0885-4514-8e7f-fb5f7cbba590 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.314527 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-e9ebe374-f825-4fa6-9884-1b00179fdc96 req-7dd218e9-0885-4514-8e7f-fb5f7cbba590 service nova] Creating event network-changed:33300b87-970b-4a82-b42e-51c6998b535a for instance 40168342-ce20-4df4-9112-60c03c657239 on hv-cinder-85144 Aug 10 23:19:51.319714 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-e9ebe374-f825-4fa6-9884-1b00179fdc96 req-7dd218e9-0885-4514-8e7f-fb5f7cbba590 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032823 Aug 10 23:19:51.320309 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 294/582] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:51.546000 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7bb3956b-fbbb-4f10-b18d-71b2746de392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:51.546797 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7bb3956b-fbbb-4f10-b18d-71b2746de392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:51.553131 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7bb3956b-fbbb-4f10-b18d-71b2746de392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.558442 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7bb3956b-fbbb-4f10-b18d-71b2746de392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.558442 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7bb3956b-fbbb-4f10-b18d-71b2746de392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.558442 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7bb3956b-fbbb-4f10-b18d-71b2746de392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.558442 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7bb3956b-fbbb-4f10-b18d-71b2746de392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.558920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7bb3956b-fbbb-4f10-b18d-71b2746de392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.713828 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7bb3956b-fbbb-4f10-b18d-71b2746de392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:51.721472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7bb3956b-fbbb-4f10-b18d-71b2746de392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.179456 Aug 10 23:19:51.722036 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 289/583] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:51 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:51.743464 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-903169f9-f9af-4d29-beea-0b87293119fc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:51.745889 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-903169f9-f9af-4d29-beea-0b87293119fc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:51.753055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-903169f9-f9af-4d29-beea-0b87293119fc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.753526 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-903169f9-f9af-4d29-beea-0b87293119fc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.753959 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-903169f9-f9af-4d29-beea-0b87293119fc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.754648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-903169f9-f9af-4d29-beea-0b87293119fc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.755117 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-903169f9-f9af-4d29-beea-0b87293119fc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.755539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-903169f9-f9af-4d29-beea-0b87293119fc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.783817 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-903169f9-f9af-4d29-beea-0b87293119fc tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045002 Aug 10 23:19:51.784290 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 295/584] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:51 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:19:51.871839 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e803a2ef-0039-4646-9131-b6abc2f00949 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:51.872333 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e803a2ef-0039-4646-9131-b6abc2f00949 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:51.878247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e803a2ef-0039-4646-9131-b6abc2f00949 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.878765 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e803a2ef-0039-4646-9131-b6abc2f00949 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.879204 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e803a2ef-0039-4646-9131-b6abc2f00949 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.879891 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e803a2ef-0039-4646-9131-b6abc2f00949 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.880349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e803a2ef-0039-4646-9131-b6abc2f00949 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.880768 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e803a2ef-0039-4646-9131-b6abc2f00949 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.905618 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e803a2ef-0039-4646-9131-b6abc2f00949 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Going to try to terminate instance {{(pid=121333) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:52.000528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:52.001143 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:52.007616 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.008097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.008700 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.009233 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.009689 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.010621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.140428 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:52.152845 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:52.154422 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:52.155770 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6e34f388-0f7a-4e22-b45f-f8cafc5f5745 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.159808 Aug 10 23:19:52.156539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 296/585] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:51 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:19:52.183050 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e803a2ef-0039-4646-9131-b6abc2f00949 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 204 len: 0 microversion: 2.1 time: 0.314748 Aug 10 23:19:52.183650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 290/586] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:51 2022] DELETE /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:52.198732 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-882dfc3b-fd9c-466f-94ad-e2e5593802f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:52.199123 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-882dfc3b-fd9c-466f-94ad-e2e5593802f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:52.205768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-882dfc3b-fd9c-466f-94ad-e2e5593802f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.206258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-882dfc3b-fd9c-466f-94ad-e2e5593802f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.206712 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-882dfc3b-fd9c-466f-94ad-e2e5593802f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.207424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-882dfc3b-fd9c-466f-94ad-e2e5593802f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.207875 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-882dfc3b-fd9c-466f-94ad-e2e5593802f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.208302 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-882dfc3b-fd9c-466f-94ad-e2e5593802f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.343159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-882dfc3b-fd9c-466f-94ad-e2e5593802f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:52.350617 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-882dfc3b-fd9c-466f-94ad-e2e5593802f9 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1689 microversion: 2.1 time: 0.156700 Aug 10 23:19:52.351200 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 297/587] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:52 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:52.743481 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c07699ef-fcf6-457d-9dbc-daeae1c6ad7c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:52.744736 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c07699ef-fcf6-457d-9dbc-daeae1c6ad7c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:52.751645 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c07699ef-fcf6-457d-9dbc-daeae1c6ad7c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.752129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c07699ef-fcf6-457d-9dbc-daeae1c6ad7c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.752569 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c07699ef-fcf6-457d-9dbc-daeae1c6ad7c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.753293 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c07699ef-fcf6-457d-9dbc-daeae1c6ad7c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.753750 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c07699ef-fcf6-457d-9dbc-daeae1c6ad7c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.754173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c07699ef-fcf6-457d-9dbc-daeae1c6ad7c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.896130 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c07699ef-fcf6-457d-9dbc-daeae1c6ad7c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:52.903587 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c07699ef-fcf6-457d-9dbc-daeae1c6ad7c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.164344 Aug 10 23:19:52.905261 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 291/588] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:52 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:53.178475 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:53.179103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:53.185357 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.185916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.186349 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.187509 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.187961 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.188384 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.323749 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:53.331521 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:53.333017 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:53.334142 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d234c57c-efc5-4791-bb77-a3a85b24f168 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.159801 Aug 10 23:19:53.334717 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 298/589] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:53 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:53.371770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0c55d3d0-d337-4c30-afee-5890683ce168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:53.372382 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0c55d3d0-d337-4c30-afee-5890683ce168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:53.378344 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-d337-4c30-afee-5890683ce168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.378866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-d337-4c30-afee-5890683ce168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.379311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-d337-4c30-afee-5890683ce168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.380008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-d337-4c30-afee-5890683ce168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.380466 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-d337-4c30-afee-5890683ce168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.380893 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-d337-4c30-afee-5890683ce168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.510931 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0c55d3d0-d337-4c30-afee-5890683ce168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:53.518344 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0c55d3d0-d337-4c30-afee-5890683ce168 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1689 microversion: 2.1 time: 0.150884 Aug 10 23:19:53.518940 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 292/590] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:53 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:53.924425 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-894ef557-c645-4e37-9945-bc9a0ce87e01 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:53.925034 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-894ef557-c645-4e37-9945-bc9a0ce87e01 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:53.931017 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-894ef557-c645-4e37-9945-bc9a0ce87e01 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.931490 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-894ef557-c645-4e37-9945-bc9a0ce87e01 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.932071 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-894ef557-c645-4e37-9945-bc9a0ce87e01 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.932758 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-894ef557-c645-4e37-9945-bc9a0ce87e01 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.933201 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-894ef557-c645-4e37-9945-bc9a0ce87e01 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.933620 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-894ef557-c645-4e37-9945-bc9a0ce87e01 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:54.063387 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-894ef557-c645-4e37-9945-bc9a0ce87e01 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:54.070548 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-894ef557-c645-4e37-9945-bc9a0ce87e01 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.149992 Aug 10 23:19:54.071139 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 299/591] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:53 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:54.356833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:54.357393 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:54.363875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:54.364358 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:54.364795 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:54.365497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:54.365957 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:54.366380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:54.496110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:54.504126 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:54.505677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:54.506808 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0eb4dfd9-d45b-4c65-b82e-0845510c29a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.153983 Aug 10 23:19:54.507364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 293/592] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:54 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:54.538878 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e71f3346-71de-4a62-b770-475dbd7b6535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:54.539493 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e71f3346-71de-4a62-b770-475dbd7b6535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:54.546077 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e71f3346-71de-4a62-b770-475dbd7b6535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:54.546550 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e71f3346-71de-4a62-b770-475dbd7b6535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:54.547036 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e71f3346-71de-4a62-b770-475dbd7b6535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:54.547725 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e71f3346-71de-4a62-b770-475dbd7b6535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:54.548174 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e71f3346-71de-4a62-b770-475dbd7b6535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:54.548603 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e71f3346-71de-4a62-b770-475dbd7b6535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:54.679391 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e71f3346-71de-4a62-b770-475dbd7b6535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:54.686849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e71f3346-71de-4a62-b770-475dbd7b6535 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1689 microversion: 2.1 time: 0.151765 Aug 10 23:19:54.687416 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 300/593] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:54 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:55.095357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-18888bf0-746a-46b7-8045-d00886ff273c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:55.095919 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-18888bf0-746a-46b7-8045-d00886ff273c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:55.101935 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18888bf0-746a-46b7-8045-d00886ff273c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:55.102420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18888bf0-746a-46b7-8045-d00886ff273c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:55.102885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18888bf0-746a-46b7-8045-d00886ff273c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:55.103591 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18888bf0-746a-46b7-8045-d00886ff273c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:55.104045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18888bf0-746a-46b7-8045-d00886ff273c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:55.104469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18888bf0-746a-46b7-8045-d00886ff273c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:55.232083 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-18888bf0-746a-46b7-8045-d00886ff273c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:55.240386 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-18888bf0-746a-46b7-8045-d00886ff273c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1367 microversion: 2.1 time: 0.151107 Aug 10 23:19:55.240954 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 294/594] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:55 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:55.529406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:55.530019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:55.536011 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:55.536493 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:55.536934 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:55.537636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:55.538093 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:55.538522 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:55.670674 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:55.678557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:55.680105 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:55.681208 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-abbfe9b8-6b6f-4efd-9a15-a5ecb31baa4e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.155760 Aug 10 23:19:55.681773 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 301/595] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:55 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:55.707508 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-bb8a8dd2-e496-4245-97f0-39d6d5ba129f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:55.708124 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-bb8a8dd2-e496-4245-97f0-39d6d5ba129f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:55.715127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bb8a8dd2-e496-4245-97f0-39d6d5ba129f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:55.715612 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bb8a8dd2-e496-4245-97f0-39d6d5ba129f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:55.716305 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bb8a8dd2-e496-4245-97f0-39d6d5ba129f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:55.717010 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bb8a8dd2-e496-4245-97f0-39d6d5ba129f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:55.717469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bb8a8dd2-e496-4245-97f0-39d6d5ba129f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:55.717893 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bb8a8dd2-e496-4245-97f0-39d6d5ba129f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:55.849023 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-bb8a8dd2-e496-4245-97f0-39d6d5ba129f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:55.856634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-bb8a8dd2-e496-4245-97f0-39d6d5ba129f tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1689 microversion: 2.1 time: 0.153037 Aug 10 23:19:55.857214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 295/596] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:55 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:56.261066 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cc7e7bb4-8cb1-4dac-b6e6-a8292181af64 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:56.261713 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cc7e7bb4-8cb1-4dac-b6e6-a8292181af64 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:56.267654 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc7e7bb4-8cb1-4dac-b6e6-a8292181af64 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.268146 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc7e7bb4-8cb1-4dac-b6e6-a8292181af64 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.268668 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc7e7bb4-8cb1-4dac-b6e6-a8292181af64 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.269437 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc7e7bb4-8cb1-4dac-b6e6-a8292181af64 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.269900 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc7e7bb4-8cb1-4dac-b6e6-a8292181af64 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.270330 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc7e7bb4-8cb1-4dac-b6e6-a8292181af64 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.574172 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cc7e7bb4-8cb1-4dac-b6e6-a8292181af64 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:56.581649 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cc7e7bb4-8cb1-4dac-b6e6-a8292181af64 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1557 microversion: 2.1 time: 0.325042 Aug 10 23:19:56.582225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 302/597] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:56 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1557 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:56.602412 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9b325438-05df-4487-a72f-4e88bf624c2c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:56.602948 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9b325438-05df-4487-a72f-4e88bf624c2c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:56.609753 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b325438-05df-4487-a72f-4e88bf624c2c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.610235 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b325438-05df-4487-a72f-4e88bf624c2c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.610696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b325438-05df-4487-a72f-4e88bf624c2c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.611573 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b325438-05df-4487-a72f-4e88bf624c2c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.612041 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b325438-05df-4487-a72f-4e88bf624c2c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.612465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9b325438-05df-4487-a72f-4e88bf624c2c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.703715 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:56.704332 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:56.710592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.711129 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.711642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.712292 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.712755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.713189 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.723630 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9b325438-05df-4487-a72f-4e88bf624c2c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125009 Aug 10 23:19:56.724889 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 296/598] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 10 23:19:56 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:56.877871 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4b3a5faa-4620-47ab-ad1c-56bded9fa971 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:56.878496 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4b3a5faa-4620-47ab-ad1c-56bded9fa971 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:56.885384 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b3a5faa-4620-47ab-ad1c-56bded9fa971 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.885880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b3a5faa-4620-47ab-ad1c-56bded9fa971 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.886529 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b3a5faa-4620-47ab-ad1c-56bded9fa971 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.887282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b3a5faa-4620-47ab-ad1c-56bded9fa971 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.887748 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b3a5faa-4620-47ab-ad1c-56bded9fa971 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.888229 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b3a5faa-4620-47ab-ad1c-56bded9fa971 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.907193 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:56.917946 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:56.920602 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:56.923207 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1202da5b-7517-4c2f-9f7c-aee21cbf04cc tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.222286 Aug 10 23:19:56.923207 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 303/599] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:56 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:56.985444 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4b3a5faa-4620-47ab-ad1c-56bded9fa971 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:56.994191 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4b3a5faa-4620-47ab-ad1c-56bded9fa971 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1622 microversion: 2.1 time: 0.120256 Aug 10 23:19:56.995446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 297/600] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:56 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1622 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:57.533554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-dc2006f0-74c5-4e66-a591-11ab86cf65f4 req-b7fdf805-3083-46b5-8d9c-5064ec301b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f942a5b6-08d7-4d52-a7bd-1af4aaba1930", "name": "network-vif-deleted", "tag": "a4fdf480-4b42-4de5-8380-f1aec638d9a7"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:57.539923 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=4 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:57.540682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=20 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:57.547883 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-dc2006f0-74c5-4e66-a591-11ab86cf65f4 req-b7fdf805-3083-46b5-8d9c-5064ec301b99 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:57.548458 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-dc2006f0-74c5-4e66-a591-11ab86cf65f4 req-b7fdf805-3083-46b5-8d9c-5064ec301b99 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:57.549049 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-dc2006f0-74c5-4e66-a591-11ab86cf65f4 req-b7fdf805-3083-46b5-8d9c-5064ec301b99 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:57.565072 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-dc2006f0-74c5-4e66-a591-11ab86cf65f4 req-b7fdf805-3083-46b5-8d9c-5064ec301b99 service nova] Creating event network-vif-deleted:a4fdf480-4b42-4de5-8380-f1aec638d9a7 for instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 on hv-cinder-85144 Aug 10 23:19:57.571543 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-dc2006f0-74c5-4e66-a591-11ab86cf65f4 req-b7fdf805-3083-46b5-8d9c-5064ec301b99 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041417 Aug 10 23:19:57.573035 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 304/601] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:57.945108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:57.945800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:57.948739 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=4 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:57.954905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:57.955877 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:57.955877 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:57.956842 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:57.957491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:57.957919 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:58.016733 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ce7f3b6b-e46b-4b69-bd65-3b893494a201 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:58.017375 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ce7f3b6b-e46b-4b69-bd65-3b893494a201 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:58.029972 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce7f3b6b-e46b-4b69-bd65-3b893494a201 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:58.030864 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce7f3b6b-e46b-4b69-bd65-3b893494a201 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:58.031498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce7f3b6b-e46b-4b69-bd65-3b893494a201 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:58.032400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce7f3b6b-e46b-4b69-bd65-3b893494a201 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:58.033173 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce7f3b6b-e46b-4b69-bd65-3b893494a201 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:58.033778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce7f3b6b-e46b-4b69-bd65-3b893494a201 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:58.135557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ce7f3b6b-e46b-4b69-bd65-3b893494a201 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:58.143920 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ce7f3b6b-e46b-4b69-bd65-3b893494a201 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1622 microversion: 2.1 time: 0.131553 Aug 10 23:19:58.150864 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 305/602] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:58 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1622 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:58.157319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:58.166915 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:58.168661 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:58.169880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6813b3a5-fb87-40a3-92bc-ec4f41374bab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.228935 Aug 10 23:19:58.187715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 298/603] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:57 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:58.223554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-eb1b77cd-589d-4835-a8f1-8258b1c7ea4b req-ce21cb86-4cbe-4adb-a2ec-96a5da4855d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54661f9-1a04-4076-9cad-bbef28ed6e3d", "tag": "1c047fed-fd6b-486e-865f-6dd6859da484"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:58.236983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-eb1b77cd-589d-4835-a8f1-8258b1c7ea4b req-ce21cb86-4cbe-4adb-a2ec-96a5da4855d6 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:58.237617 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-eb1b77cd-589d-4835-a8f1-8258b1c7ea4b req-ce21cb86-4cbe-4adb-a2ec-96a5da4855d6 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:58.238337 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-eb1b77cd-589d-4835-a8f1-8258b1c7ea4b req-ce21cb86-4cbe-4adb-a2ec-96a5da4855d6 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:58.252261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-eb1b77cd-589d-4835-a8f1-8258b1c7ea4b req-ce21cb86-4cbe-4adb-a2ec-96a5da4855d6 service nova] Creating event network-changed:1c047fed-fd6b-486e-865f-6dd6859da484 for instance b54661f9-1a04-4076-9cad-bbef28ed6e3d on hv-cinder-85144 Aug 10 23:19:58.257608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-eb1b77cd-589d-4835-a8f1-8258b1c7ea4b req-ce21cb86-4cbe-4adb-a2ec-96a5da4855d6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105317 Aug 10 23:19:58.260603 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 306/604] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:59.167696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:59.175730 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:59.176199 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:59.176706 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:59.177135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:59.177842 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:59.178307 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:59.178769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:59.195897 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:59.196826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:59.204579 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:59.205162 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:59.205664 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:59.206438 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:59.207023 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:59.207513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:59.215781 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:59.216797 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:59.217457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:59.217995 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lazy-loading 'fault' on Instance uuid f942a5b6-08d7-4d52-a7bd-1af4aaba1930 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:59.287918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:59.296493 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dce28205-6a69-457c-901c-71d2824f7f51 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 200 len: 1335 microversion: 2.1 time: 0.133399 Aug 10 23:19:59.299382 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 299/605] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:59 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 1335 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:59.368481 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:59.377564 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:59.379097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:59.381545 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-23588f59-1377-41d2-b06a-99315fdc0eb3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.188658 Aug 10 23:19:59.381545 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 307/606] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:59 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:00.320636 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:00.321186 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: f942a5b6-08d7-4d52-a7bd-1af4aaba1930] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:00.328136 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:00.328619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:00.329073 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:00.329763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:00.330221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:00.330674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:00.344785 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] HTTP exception thrown: Instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 could not be found. Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Request method failure captured: Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 HTTP/1.1 Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DuabME7ZGHzYuz08OVq0R6TMPx--LgzVwK_UREHcD3-PQE3MaV4jBWp2AYr2OKi7kcY9Vep3prjScfU6CpAWsU3OQNYBRfCrSgAvD1_qxdd5aQVPMLlOmxehX_8VTrbZuX8lzptxALoTxaoIDfjKODnb2VEQefb9Lta9-c0yMzMMPY Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: be0d52e189904e3c9971960d3ff4f58b Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:20:00.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_be0d52e189904e3c9971960d3ff4f58b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: be0d52e189904e3c9971960d3ff4f58b Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-ServerRescueNegativeTestJSON-1544132578-project Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: ffb46379ef204df6bebd58f3bdb78ff6 Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1544132578-project Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 could not be found. Aug 10 23:20:00.348208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'f942a5b6-08d7-4d52-a7bd-1af4aaba1930'} Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 could not be found. Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:00.349119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 could not be found. Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 could not be found. Aug 10 23:20:00.350732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:20:00.352462 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Returning 404 to user: Instance f942a5b6-08d7-4d52-a7bd-1af4aaba1930 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:00.352462 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b660b175-c343-4976-b9f0-34381742bb95 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930" status: 404 len: 111 microversion: 2.1 time: 0.031216 Aug 10 23:20:00.352462 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 300/607] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:00 2022] GET /compute/v2.1/servers/f942a5b6-08d7-4d52-a7bd-1af4aaba1930 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:20:00.356983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-de2853a7-6dca-4727-81a6-d4253106a626 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '.version_select at 0x7fe833e69550>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:00.404603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:00.405221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:00.411421 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:00.411916 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:00.412341 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:00.413084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:00.413547 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:00.414046 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:00.426528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-de2853a7-6dca-4727-81a6-d4253106a626 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-868453007" status: 202 len: 0 microversion: 2.1 time: 0.073385 Aug 10 23:20:00.428055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 308/608] 10.222.0.78 () {58 vars in 1218 bytes} [Wed Aug 10 23:20:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-868453007 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:20:00.557697 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:00.565984 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:00.567514 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:00.568926 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a48d9c50-f8fc-4347-8f5e-188caf81a69b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.168888 Aug 10 23:20:00.569481 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 301/609] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:00 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:01.593425 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:01.594040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:01.600735 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:01.601215 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:01.601648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:01.602388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:01.602872 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:01.603351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:01.731654 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:01.739535 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:01.741126 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:01.742120 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8aa6fac4-4b78-4f54-8ae9-dfe61fcfbe63 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.153453 Aug 10 23:20:01.742922 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 309/610] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:01 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:02.589194 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-ed74a3b6-ef5d-4a1e-a5d2-d3a24eefd3f7 req-b48fc152-39e5-4d04-982a-4a3888caa745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40168342-ce20-4df4-9112-60c03c657239", "name": "network-vif-plugged", "status": "completed", "tag": "33300b87-970b-4a82-b42e-51c6998b535a"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:02.589194 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:02.592625 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-ed74a3b6-ef5d-4a1e-a5d2-d3a24eefd3f7 req-b48fc152-39e5-4d04-982a-4a3888caa745 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:02.593110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-ed74a3b6-ef5d-4a1e-a5d2-d3a24eefd3f7 req-b48fc152-39e5-4d04-982a-4a3888caa745 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:02.593545 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-ed74a3b6-ef5d-4a1e-a5d2-d3a24eefd3f7 req-b48fc152-39e5-4d04-982a-4a3888caa745 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:02.604901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-ed74a3b6-ef5d-4a1e-a5d2-d3a24eefd3f7 req-b48fc152-39e5-4d04-982a-4a3888caa745 service nova] Creating event network-vif-plugged:33300b87-970b-4a82-b42e-51c6998b535a for instance 40168342-ce20-4df4-9112-60c03c657239 on hv-cinder-85144 Aug 10 23:20:02.610258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-ed74a3b6-ef5d-4a1e-a5d2-d3a24eefd3f7 req-b48fc152-39e5-4d04-982a-4a3888caa745 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Aug 10 23:20:02.610980 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 302/611] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:02.765189 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:02.765804 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:02.772281 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:02.772770 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:02.773209 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:02.773909 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:02.774371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:02.774831 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:02.957854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:02.968429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:02.970052 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:02.971236 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-26974150-f85f-460f-bfca-25eadc3a8619 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.209948 Aug 10 23:20:02.971805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 310/612] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:02 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:03.883411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a96487c1-2f14-49ee-85f6-dd6b2acec5a5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:03.883994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a96487c1-2f14-49ee-85f6-dd6b2acec5a5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:03.890296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a96487c1-2f14-49ee-85f6-dd6b2acec5a5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:03.890828 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a96487c1-2f14-49ee-85f6-dd6b2acec5a5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:03.891270 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a96487c1-2f14-49ee-85f6-dd6b2acec5a5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:03.891962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a96487c1-2f14-49ee-85f6-dd6b2acec5a5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:03.892414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a96487c1-2f14-49ee-85f6-dd6b2acec5a5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:03.892838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a96487c1-2f14-49ee-85f6-dd6b2acec5a5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:03.907936 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:03.918956 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a96487c1-2f14-49ee-85f6-dd6b2acec5a5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Going to try to terminate instance {{(pid=121333) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:20:03.994047 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:03.994697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:04.000999 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:04.001480 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:04.001918 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:04.002620 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:04.003103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:04.003530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:04.136436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:04.144800 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:04.146363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:04.147514 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4a6b54f7-14b2-48e5-b29c-72634c85a094 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1408 microversion: 2.20 time: 0.157453 Aug 10 23:20:04.157683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 311/613] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:03 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:04.234136 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a96487c1-2f14-49ee-85f6-dd6b2acec5a5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 204 len: 0 microversion: 2.1 time: 0.355548 Aug 10 23:20:04.234775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 303/614] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:20:03 2022] DELETE /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:20:04.243051 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9f7aea23-c0a1-4553-9d97-eb5062f6fcd1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:04.243673 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9f7aea23-c0a1-4553-9d97-eb5062f6fcd1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:04.249623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f7aea23-c0a1-4553-9d97-eb5062f6fcd1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:04.250134 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f7aea23-c0a1-4553-9d97-eb5062f6fcd1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:04.250784 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f7aea23-c0a1-4553-9d97-eb5062f6fcd1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:04.251481 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f7aea23-c0a1-4553-9d97-eb5062f6fcd1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:04.251942 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f7aea23-c0a1-4553-9d97-eb5062f6fcd1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:04.252373 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9f7aea23-c0a1-4553-9d97-eb5062f6fcd1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:04.384161 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-9f7aea23-c0a1-4553-9d97-eb5062f6fcd1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:04.392209 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9f7aea23-c0a1-4553-9d97-eb5062f6fcd1 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1507 microversion: 2.1 time: 0.153122 Aug 10 23:20:04.392777 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 312/615] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:04 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:05.171305 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:05.172033 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:05.177990 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:05.178467 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:05.178933 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:05.179618 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:05.180067 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:05.180485 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:05.313080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:05.321481 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:05.323000 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:05.324154 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d1ce12a0-60ef-4ae3-84e1-1589844c163a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1600 microversion: 2.20 time: 0.157418 Aug 10 23:20:05.324695 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 304/616] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:05 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:05.347101 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-52125052-c840-40a8-abf0-604f6648a9e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:05.347644 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-52125052-c840-40a8-abf0-604f6648a9e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:05.354409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52125052-c840-40a8-abf0-604f6648a9e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:05.354930 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52125052-c840-40a8-abf0-604f6648a9e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:05.355366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52125052-c840-40a8-abf0-604f6648a9e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:05.356063 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52125052-c840-40a8-abf0-604f6648a9e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:05.356513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52125052-c840-40a8-abf0-604f6648a9e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:05.356935 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52125052-c840-40a8-abf0-604f6648a9e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:05.360688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=100 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:05.413115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-245b2b88-2f2e-4b13-893c-1640b80a9281 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:05.413627 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-245b2b88-2f2e-4b13-893c-1640b80a9281 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:05.420134 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-245b2b88-2f2e-4b13-893c-1640b80a9281 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:05.421270 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-245b2b88-2f2e-4b13-893c-1640b80a9281 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:05.421270 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-245b2b88-2f2e-4b13-893c-1640b80a9281 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:05.421759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-245b2b88-2f2e-4b13-893c-1640b80a9281 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:05.422278 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-245b2b88-2f2e-4b13-893c-1640b80a9281 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:05.422738 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-245b2b88-2f2e-4b13-893c-1640b80a9281 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:05.433690 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-52125052-c840-40a8-abf0-604f6648a9e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090503 Aug 10 23:20:05.434318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 313/617] 10.222.0.78 () {60 vars in 1316 bytes} [Wed Aug 10 23:20:05 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:20:05.556058 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-245b2b88-2f2e-4b13-893c-1640b80a9281 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:05.563791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-245b2b88-2f2e-4b13-893c-1640b80a9281 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1507 microversion: 2.1 time: 0.154563 Aug 10 23:20:05.564371 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 305/618] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:05 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:06.599406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7a65c59a-10e8-46e9-899d-65e42e620b34 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:06.600055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7a65c59a-10e8-46e9-899d-65e42e620b34 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:06.611536 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7a65c59a-10e8-46e9-899d-65e42e620b34 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:06.614700 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7a65c59a-10e8-46e9-899d-65e42e620b34 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:06.616813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7a65c59a-10e8-46e9-899d-65e42e620b34 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:06.617466 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7a65c59a-10e8-46e9-899d-65e42e620b34 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:06.617941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7a65c59a-10e8-46e9-899d-65e42e620b34 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:06.621319 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7a65c59a-10e8-46e9-899d-65e42e620b34 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:06.626905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-22af01eb-72eb-46f7-8434-bfd6c506419e req-9cffda42-6f76-4a2e-a230-7a06c13c0507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40168342-ce20-4df4-9112-60c03c657239", "tag": "33300b87-970b-4a82-b42e-51c6998b535a"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:06.638676 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-22af01eb-72eb-46f7-8434-bfd6c506419e req-9cffda42-6f76-4a2e-a230-7a06c13c0507 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:06.639454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-22af01eb-72eb-46f7-8434-bfd6c506419e req-9cffda42-6f76-4a2e-a230-7a06c13c0507 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:06.640094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-22af01eb-72eb-46f7-8434-bfd6c506419e req-9cffda42-6f76-4a2e-a230-7a06c13c0507 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:06.656785 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-22af01eb-72eb-46f7-8434-bfd6c506419e req-9cffda42-6f76-4a2e-a230-7a06c13c0507 service nova] Creating event network-changed:33300b87-970b-4a82-b42e-51c6998b535a for instance 40168342-ce20-4df4-9112-60c03c657239 on hv-cinder-85144 Aug 10 23:20:06.662979 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-22af01eb-72eb-46f7-8434-bfd6c506419e req-9cffda42-6f76-4a2e-a230-7a06c13c0507 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039733 Aug 10 23:20:06.664137 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 306/619] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:20:06.916875 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7a65c59a-10e8-46e9-899d-65e42e620b34 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:06.925962 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7a65c59a-10e8-46e9-899d-65e42e620b34 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1507 microversion: 2.1 time: 0.343788 Aug 10 23:20:06.926796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 314/620] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:06 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:07.144711 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-e0870f01-39fe-4a6a-9001-67303b8b54eb req-7435bd4d-ec42-4945-b24b-5032dc86524e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a85987-a755-456a-9d00-0992cbe4368a", "name": "network-vif-deleted", "tag": "f1b4d3c9-dbce-4d0a-a2e7-1dfdd40931a0"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:07.159513 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-e0870f01-39fe-4a6a-9001-67303b8b54eb req-7435bd4d-ec42-4945-b24b-5032dc86524e service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.160098 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-e0870f01-39fe-4a6a-9001-67303b8b54eb req-7435bd4d-ec42-4945-b24b-5032dc86524e service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.160597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-e0870f01-39fe-4a6a-9001-67303b8b54eb req-7435bd4d-ec42-4945-b24b-5032dc86524e service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.182536 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-e0870f01-39fe-4a6a-9001-67303b8b54eb req-7435bd4d-ec42-4945-b24b-5032dc86524e service nova] Creating event network-vif-deleted:f1b4d3c9-dbce-4d0a-a2e7-1dfdd40931a0 for instance e3a85987-a755-456a-9d00-0992cbe4368a on hv-cinder-85144 Aug 10 23:20:07.190521 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-e0870f01-39fe-4a6a-9001-67303b8b54eb req-7435bd4d-ec42-4945-b24b-5032dc86524e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051943 Aug 10 23:20:07.191107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 307/621] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:07.952108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:07.952786 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:07.960280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.960771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.961227 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.961897 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.962356 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.962878 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.998335 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.998916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.999348 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.999795 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lazy-loading 'fault' on Instance uuid e3a85987-a755-456a-9d00-0992cbe4368a {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:20:08.044337 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:08.051905 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-466d86fd-777e-4932-9276-8b75f1da1daf tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 200 len: 1311 microversion: 2.1 time: 0.103568 Aug 10 23:20:08.052468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 315/622] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:07 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:09.074846 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:09.075544 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: e3a85987-a755-456a-9d00-0992cbe4368a] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:09.081752 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:09.082234 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:09.082813 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:09.083391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:09.083847 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:09.084273 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:09.097251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] HTTP exception thrown: Instance e3a85987-a755-456a-9d00-0992cbe4368a could not be found. Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Request method failure captured: Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a HTTP/1.1 Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DuabME7ZGHzYuz08OVq0R6TMPx--LgzVwK_UREHcD3-PQE3MaV4jBWp2AYr2OKi7kcY9Vep3prjScfU6CpAWsU3OQNYBRfCrSgAvD1_qxdd5aQVPMLlOmxehX_8VTrbZuX8lzptxALoTxaoIDfjKODnb2VEQefb9Lta9-c0yMzMMPY Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: be0d52e189904e3c9971960d3ff4f58b Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:20:09.098885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_be0d52e189904e3c9971960d3ff4f58b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: be0d52e189904e3c9971960d3ff4f58b Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-ServerRescueNegativeTestJSON-1544132578-project Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: ffb46379ef204df6bebd58f3bdb78ff6 Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1544132578-project Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance e3a85987-a755-456a-9d00-0992cbe4368a could not be found. Aug 10 23:20:09.100472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'e3a85987-a755-456a-9d00-0992cbe4368a'} Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a85987-a755-456a-9d00-0992cbe4368a could not be found. Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:09.101280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a85987-a755-456a-9d00-0992cbe4368a could not be found. Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a85987-a755-456a-9d00-0992cbe4368a could not be found. Aug 10 23:20:09.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:20:09.103620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Returning 404 to user: Instance e3a85987-a755-456a-9d00-0992cbe4368a could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:09.103620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-67a97123-465d-4043-a253-cfaf5c5940d3 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a" status: 404 len: 111 microversion: 2.1 time: 0.030792 Aug 10 23:20:09.103620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 308/623] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:09 2022] GET /compute/v2.1/servers/e3a85987-a755-456a-9d00-0992cbe4368a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:20:09.108767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cc482c45-182e-4638-a963-501bdb316989 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:09.109270 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cc482c45-182e-4638-a963-501bdb316989 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:09.115664 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc482c45-182e-4638-a963-501bdb316989 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:09.116148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc482c45-182e-4638-a963-501bdb316989 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:09.116586 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc482c45-182e-4638-a963-501bdb316989 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:09.117286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc482c45-182e-4638-a963-501bdb316989 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:09.117746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc482c45-182e-4638-a963-501bdb316989 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:09.118178 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc482c45-182e-4638-a963-501bdb316989 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:09.143419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cc482c45-182e-4638-a963-501bdb316989 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:20:09.456607 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cc482c45-182e-4638-a963-501bdb316989 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 204 len: 0 microversion: 2.1 time: 0.351269 Aug 10 23:20:09.457200 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 316/624] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:20:09 2022] DELETE /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:20:09.465286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-cba3dbcc-e0ff-4650-b220-fd31f226a548 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:09.466205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-cba3dbcc-e0ff-4650-b220-fd31f226a548 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:09.473041 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cba3dbcc-e0ff-4650-b220-fd31f226a548 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:09.473529 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cba3dbcc-e0ff-4650-b220-fd31f226a548 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:09.474019 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cba3dbcc-e0ff-4650-b220-fd31f226a548 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:09.474816 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cba3dbcc-e0ff-4650-b220-fd31f226a548 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:09.475281 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cba3dbcc-e0ff-4650-b220-fd31f226a548 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:09.475711 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cba3dbcc-e0ff-4650-b220-fd31f226a548 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:09.610568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cba3dbcc-e0ff-4650-b220-fd31f226a548 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:09.618116 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-cba3dbcc-e0ff-4650-b220-fd31f226a548 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.156676 Aug 10 23:20:09.618760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 309/625] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:09 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:10.639135 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2d776c10-0b28-4bca-9303-ff9fb60e4850 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:10.639837 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2d776c10-0b28-4bca-9303-ff9fb60e4850 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:10.646221 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d776c10-0b28-4bca-9303-ff9fb60e4850 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:10.646739 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d776c10-0b28-4bca-9303-ff9fb60e4850 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:10.647178 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d776c10-0b28-4bca-9303-ff9fb60e4850 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:10.647874 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d776c10-0b28-4bca-9303-ff9fb60e4850 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:10.648328 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d776c10-0b28-4bca-9303-ff9fb60e4850 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:10.648758 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2d776c10-0b28-4bca-9303-ff9fb60e4850 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:10.781629 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2d776c10-0b28-4bca-9303-ff9fb60e4850 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:10.789045 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2d776c10-0b28-4bca-9303-ff9fb60e4850 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.154221 Aug 10 23:20:10.789602 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 317/626] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:10 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:11.810430 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-736420ee-8407-4182-b7d2-3f9ba3fa2cb4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:11.811050 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-736420ee-8407-4182-b7d2-3f9ba3fa2cb4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:11.817537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-736420ee-8407-4182-b7d2-3f9ba3fa2cb4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:11.818016 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-736420ee-8407-4182-b7d2-3f9ba3fa2cb4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:11.823250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-736420ee-8407-4182-b7d2-3f9ba3fa2cb4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:11.823250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-736420ee-8407-4182-b7d2-3f9ba3fa2cb4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:11.823250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-736420ee-8407-4182-b7d2-3f9ba3fa2cb4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:11.823250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-736420ee-8407-4182-b7d2-3f9ba3fa2cb4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:11.950975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-736420ee-8407-4182-b7d2-3f9ba3fa2cb4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:11.958482 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-736420ee-8407-4182-b7d2-3f9ba3fa2cb4 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1522 microversion: 2.1 time: 0.152962 Aug 10 23:20:11.959073 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 310/627] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:11 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:12.556657 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-180b8005-c8a0-4318-ab5f-429dabc821c6 req-7fcce96c-8984-4b47-87c7-a30635354445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7ea374-a02e-4bdc-a8ed-02453f7dcc66", "name": "network-vif-deleted", "tag": "e7890e54-55df-4695-9a95-9f617e451cc1"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:12.568199 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-180b8005-c8a0-4318-ab5f-429dabc821c6 req-7fcce96c-8984-4b47-87c7-a30635354445 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:12.568199 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-180b8005-c8a0-4318-ab5f-429dabc821c6 req-7fcce96c-8984-4b47-87c7-a30635354445 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:12.568199 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-180b8005-c8a0-4318-ab5f-429dabc821c6 req-7fcce96c-8984-4b47-87c7-a30635354445 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:12.584580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-180b8005-c8a0-4318-ab5f-429dabc821c6 req-7fcce96c-8984-4b47-87c7-a30635354445 service nova] Creating event network-vif-deleted:e7890e54-55df-4695-9a95-9f617e451cc1 for instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 on hv-cinder-85144 Aug 10 23:20:12.589711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-180b8005-c8a0-4318-ab5f-429dabc821c6 req-7fcce96c-8984-4b47-87c7-a30635354445 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036607 Aug 10 23:20:12.593594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 318/628] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:12.980876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:12.981492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:12.988129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:12.988645 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:12.989081 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:12.989871 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:12.990380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:12.990833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:13.021481 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:13.021956 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:13.022386 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:13.022855 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lazy-loading 'fault' on Instance uuid 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:20:13.066511 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb46379ef204df6bebd58f3bdb78ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0d52e189904e3c9971960d3ff4f58b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:13.074084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8752941a-b3d3-4266-b6b7-71989224f36c tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 200 len: 1311 microversion: 2.1 time: 0.097490 Aug 10 23:20:13.076368 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 311/629] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:12 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:14.096508 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:14.097158 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] [instance: 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:14.103229 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:14.103731 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:14.104144 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:14.105423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:14.105878 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:14.106305 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:14.119245 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] HTTP exception thrown: Instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 could not be found. Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Request method failure captured: Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 HTTP/1.1 Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DuabME7ZGHzYuz08OVq0R6TMPx--LgzVwK_UREHcD3-PQE3MaV4jBWp2AYr2OKi7kcY9Vep3prjScfU6CpAWsU3OQNYBRfCrSgAvD1_qxdd5aQVPMLlOmxehX_8VTrbZuX8lzptxALoTxaoIDfjKODnb2VEQefb9Lta9-c0yMzMMPY Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: be0d52e189904e3c9971960d3ff4f58b Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:20:14.120826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/be0d52e189904e3c9971960d3ff4f58b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_be0d52e189904e3c9971960d3ff4f58b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: be0d52e189904e3c9971960d3ff4f58b Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1544132578 Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-ServerRescueNegativeTestJSON-1544132578-project Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: ffb46379ef204df6bebd58f3bdb78ff6 Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1544132578-project Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 could not be found. Aug 10 23:20:14.122100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': '8a7ea374-a02e-4bdc-a8ed-02453f7dcc66'} Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 could not be found. Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:14.122877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 could not be found. Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 could not be found. Aug 10 23:20:14.124365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:20:14.125691 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] Returning 404 to user: Instance 8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:14.125691 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0d2096e1-eead-4303-8f94-9ea5881467d5 tempest-ServerRescueNegativeTestJSON-1544132578 tempest-ServerRescueNegativeTestJSON-1544132578-project] 10.222.0.78 "GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66" status: 404 len: 111 microversion: 2.1 time: 0.030451 Aug 10 23:20:14.125691 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 319/630] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:14 2022] GET /compute/v2.1/servers/8a7ea374-a02e-4bdc-a8ed-02453f7dcc66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:20:25.095272 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:25.096021 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:25.217664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-97a6b4e4-d78c-46a9-ad79-a35fa2b5f979 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'create', calling method: .version_select at 0x7fe8406a2430>, body: {"keypair": {"name": "tempest-keypair-736967743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLk6wIAx5kRguzxg/e17kafZhr7VrrnsbkEmV+nAtb/PTF8G9eC4Sjf5w0cj+npv9PPz6Jr9tmFG2F7vtsrjlR4bPisKVaWgjz/g6lJu6d1mLKPrkdNh9nqZKJ+l3tpzwQ=="}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:25.232141 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-97a6b4e4-d78c-46a9-ad79-a35fa2b5f979 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Getting quotas for project e72afdc971a44dd6a4eaabd40c40bbcb. Resources: {'key_pairs'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:20:25.236216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-97a6b4e4-d78c-46a9-ad79-a35fa2b5f979 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Getting quotas for user 35af5d49420a437193f2525bda7550d9 and project e72afdc971a44dd6a4eaabd40c40bbcb. Resources: {'key_pairs'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:20:25.338185 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-97a6b4e4-d78c-46a9-ad79-a35fa2b5f979 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.248337 Aug 10 23:20:25.338731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 312/631] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 10 23:20:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:27.657463 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-244861221", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a06e0c39-ab76-4832-8445-cbc86e99f9b0"}], "security_groups": [{"name": "tempest-securitygroup--221995199"}], "key_name": "tempest-keypair-736967743", "user_data": "}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:27.666143 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:27.667568 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:27.777013 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.network.neutron [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] validate_networks() for [('a06e0c39-ab76-4832-8445-cbc86e99f9b0', None, None, None, None, None)] {{(pid=121332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:20:28.188843 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Flavor limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:20:28.189337 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Image limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:20:28.190063 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Flavor pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:20:28.190576 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Image pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:20:28.191104 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:20:28.201658 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:28.202511 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:28.202993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:28.203736 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:28.204224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:28.204847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:28.225576 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Getting quotas for project e72afdc971a44dd6a4eaabd40c40bbcb. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:20:28.230184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Getting quotas for user 35af5d49420a437193f2525bda7550d9 and project e72afdc971a44dd6a4eaabd40c40bbcb. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:20:28.242091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Going to run 1 instances... {{(pid=121332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:20:28.244458 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:20:28.356923 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f13c6538-481f-4dbf-8212-be611a60b7f2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.703491 Aug 10 23:20:28.357886 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 320/632] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:20:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:20:28.369394 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5ec06ab9-21fe-4204-abf5-7cd65bb560e9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:28.371119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5ec06ab9-21fe-4204-abf5-7cd65bb560e9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:28.452666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5ec06ab9-21fe-4204-abf5-7cd65bb560e9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:28.462020 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5ec06ab9-21fe-4204-abf5-7cd65bb560e9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1236 microversion: 2.1 time: 0.096428 Aug 10 23:20:28.476594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 313/633] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:28 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1236 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:29.484792 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3cf6a7e6-439b-4410-8311-c03a299da78c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:29.485371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3cf6a7e6-439b-4410-8311-c03a299da78c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:29.542741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3cf6a7e6-439b-4410-8311-c03a299da78c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:29.549404 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3cf6a7e6-439b-4410-8311-c03a299da78c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1236 microversion: 2.1 time: 0.068656 Aug 10 23:20:29.549955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 321/634] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:29 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:30.571424 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-62a82334-4a1b-4584-8872-15583968193e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:30.572038 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-62a82334-4a1b-4584-8872-15583968193e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:30.579500 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62a82334-4a1b-4584-8872-15583968193e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:30.579990 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62a82334-4a1b-4584-8872-15583968193e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:30.580430 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62a82334-4a1b-4584-8872-15583968193e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:30.581128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62a82334-4a1b-4584-8872-15583968193e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:30.581605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62a82334-4a1b-4584-8872-15583968193e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:30.582035 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-62a82334-4a1b-4584-8872-15583968193e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:30.647945 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-62a82334-4a1b-4584-8872-15583968193e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:30.656037 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-62a82334-4a1b-4584-8872-15583968193e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1288 microversion: 2.1 time: 0.088702 Aug 10 23:20:30.656606 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 314/635] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:30 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:31.676829 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-907a891b-f916-42b9-a812-bbd5ad818bed tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:31.677443 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-907a891b-f916-42b9-a812-bbd5ad818bed tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:31.684481 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-907a891b-f916-42b9-a812-bbd5ad818bed tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.684992 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-907a891b-f916-42b9-a812-bbd5ad818bed tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.685424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-907a891b-f916-42b9-a812-bbd5ad818bed tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.686119 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-907a891b-f916-42b9-a812-bbd5ad818bed tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.686574 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-907a891b-f916-42b9-a812-bbd5ad818bed tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.687024 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-907a891b-f916-42b9-a812-bbd5ad818bed tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.945804 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-907a891b-f916-42b9-a812-bbd5ad818bed tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:31.947993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-907a891b-f916-42b9-a812-bbd5ad818bed tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1361 microversion: 2.1 time: 0.274963 Aug 10 23:20:31.948653 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 322/636] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:31 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:32.778413 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-0260fd45-666b-490f-bcc7-9af9d6682617 req-11b15839-4b7f-40c9-bc99-34f2bd1f6e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ed0bfa-e1e6-429e-b615-567dbbc217a9", "tag": "cfb5a114-7f09-4646-a431-86f19b7d5378"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:32.788316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-0260fd45-666b-490f-bcc7-9af9d6682617 req-11b15839-4b7f-40c9-bc99-34f2bd1f6e14 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.788794 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-0260fd45-666b-490f-bcc7-9af9d6682617 req-11b15839-4b7f-40c9-bc99-34f2bd1f6e14 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.789222 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-0260fd45-666b-490f-bcc7-9af9d6682617 req-11b15839-4b7f-40c9-bc99-34f2bd1f6e14 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:32.802382 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-0260fd45-666b-490f-bcc7-9af9d6682617 req-11b15839-4b7f-40c9-bc99-34f2bd1f6e14 service nova] Creating event network-changed:cfb5a114-7f09-4646-a431-86f19b7d5378 for instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 on hv-cinder-85144 Aug 10 23:20:32.807777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-0260fd45-666b-490f-bcc7-9af9d6682617 req-11b15839-4b7f-40c9-bc99-34f2bd1f6e14 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033252 Aug 10 23:20:32.808415 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 315/637] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:32.971181 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-105400d9-a966-478f-9ab3-85c8a70b4f20 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:32.971801 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-105400d9-a966-478f-9ab3-85c8a70b4f20 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:32.977722 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-105400d9-a966-478f-9ab3-85c8a70b4f20 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.978223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-105400d9-a966-478f-9ab3-85c8a70b4f20 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.978680 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-105400d9-a966-478f-9ab3-85c8a70b4f20 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:32.980137 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-105400d9-a966-478f-9ab3-85c8a70b4f20 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.980633 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-105400d9-a966-478f-9ab3-85c8a70b4f20 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.981025 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-105400d9-a966-478f-9ab3-85c8a70b4f20 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:33.169274 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-105400d9-a966-478f-9ab3-85c8a70b4f20 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:33.176799 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-105400d9-a966-478f-9ab3-85c8a70b4f20 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1361 microversion: 2.1 time: 0.209897 Aug 10 23:20:33.177366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 323/638] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:32 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:34.199012 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-16071bb9-b009-4d03-91da-f65a006e648a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:34.199648 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-16071bb9-b009-4d03-91da-f65a006e648a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:34.205816 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16071bb9-b009-4d03-91da-f65a006e648a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:34.206297 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16071bb9-b009-4d03-91da-f65a006e648a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:34.206775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16071bb9-b009-4d03-91da-f65a006e648a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:34.207468 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16071bb9-b009-4d03-91da-f65a006e648a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:34.207924 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16071bb9-b009-4d03-91da-f65a006e648a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:34.208350 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-16071bb9-b009-4d03-91da-f65a006e648a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:34.339972 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-16071bb9-b009-4d03-91da-f65a006e648a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:34.347694 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-16071bb9-b009-4d03-91da-f65a006e648a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1361 microversion: 2.1 time: 0.153473 Aug 10 23:20:34.348301 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 316/639] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:34 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:35.368836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-26b9155f-9483-4135-b176-3ed99f0180ba tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:35.369445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-26b9155f-9483-4135-b176-3ed99f0180ba tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:35.376467 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26b9155f-9483-4135-b176-3ed99f0180ba tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.376947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26b9155f-9483-4135-b176-3ed99f0180ba tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.377400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26b9155f-9483-4135-b176-3ed99f0180ba tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.378072 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26b9155f-9483-4135-b176-3ed99f0180ba tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.378527 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26b9155f-9483-4135-b176-3ed99f0180ba tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.378984 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-26b9155f-9483-4135-b176-3ed99f0180ba tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.508012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-26b9155f-9483-4135-b176-3ed99f0180ba tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:35.516690 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-26b9155f-9483-4135-b176-3ed99f0180ba tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1361 microversion: 2.1 time: 0.151677 Aug 10 23:20:35.517266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 324/640] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:35 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:36.540962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-cc612918-d2d2-47a1-a565-03a6357ca9aa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:36.541677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-cc612918-d2d2-47a1-a565-03a6357ca9aa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:36.548267 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cc612918-d2d2-47a1-a565-03a6357ca9aa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.548750 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cc612918-d2d2-47a1-a565-03a6357ca9aa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.549189 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cc612918-d2d2-47a1-a565-03a6357ca9aa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.549887 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cc612918-d2d2-47a1-a565-03a6357ca9aa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.550381 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cc612918-d2d2-47a1-a565-03a6357ca9aa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.550882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cc612918-d2d2-47a1-a565-03a6357ca9aa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.680232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cc612918-d2d2-47a1-a565-03a6357ca9aa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:36.688815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-cc612918-d2d2-47a1-a565-03a6357ca9aa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1361 microversion: 2.1 time: 0.151960 Aug 10 23:20:36.689442 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 317/641] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:36 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:37.709541 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5cce1c4e-c228-4d35-a5e0-6749ae31517b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:37.710159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5cce1c4e-c228-4d35-a5e0-6749ae31517b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:37.717424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cce1c4e-c228-4d35-a5e0-6749ae31517b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:37.717909 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cce1c4e-c228-4d35-a5e0-6749ae31517b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:37.718344 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cce1c4e-c228-4d35-a5e0-6749ae31517b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:37.719074 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cce1c4e-c228-4d35-a5e0-6749ae31517b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:37.719529 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cce1c4e-c228-4d35-a5e0-6749ae31517b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:37.719956 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5cce1c4e-c228-4d35-a5e0-6749ae31517b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:37.855872 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5cce1c4e-c228-4d35-a5e0-6749ae31517b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:37.863283 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5cce1c4e-c228-4d35-a5e0-6749ae31517b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1361 microversion: 2.1 time: 0.157739 Aug 10 23:20:37.863842 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 325/642] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:37 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:38.883545 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-bd2de915-49cc-4e3c-8df3-beff793e04a8 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:38.884162 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-bd2de915-49cc-4e3c-8df3-beff793e04a8 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:38.886576 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=6 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:38.891415 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bd2de915-49cc-4e3c-8df3-beff793e04a8 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:38.891897 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bd2de915-49cc-4e3c-8df3-beff793e04a8 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:38.892334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bd2de915-49cc-4e3c-8df3-beff793e04a8 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:38.893028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bd2de915-49cc-4e3c-8df3-beff793e04a8 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:38.893479 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bd2de915-49cc-4e3c-8df3-beff793e04a8 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:38.893902 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bd2de915-49cc-4e3c-8df3-beff793e04a8 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:39.023926 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-bd2de915-49cc-4e3c-8df3-beff793e04a8 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:39.032197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-bd2de915-49cc-4e3c-8df3-beff793e04a8 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1361 microversion: 2.1 time: 0.152429 Aug 10 23:20:39.032895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 318/643] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:38 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:40.053306 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2ce77155-304c-488c-84a2-3f6ca2c9244a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:40.053924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2ce77155-304c-488c-84a2-3f6ca2c9244a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:40.055822 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:40.056955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=8 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:40.062167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ce77155-304c-488c-84a2-3f6ca2c9244a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.062672 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ce77155-304c-488c-84a2-3f6ca2c9244a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.063129 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ce77155-304c-488c-84a2-3f6ca2c9244a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.063840 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ce77155-304c-488c-84a2-3f6ca2c9244a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.064353 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ce77155-304c-488c-84a2-3f6ca2c9244a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.064788 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ce77155-304c-488c-84a2-3f6ca2c9244a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.199931 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2ce77155-304c-488c-84a2-3f6ca2c9244a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:40.207293 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2ce77155-304c-488c-84a2-3f6ca2c9244a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1361 microversion: 2.1 time: 0.157811 Aug 10 23:20:40.207877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 326/644] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:40 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:40.796043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-4060774d-9844-4ad0-bc89-f2a2a94d159f req-8453cb08-af96-4aec-84a7-6c0af421afea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ed0bfa-e1e6-429e-b615-567dbbc217a9", "name": "network-vif-plugged", "status": "completed", "tag": "cfb5a114-7f09-4646-a431-86f19b7d5378"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:40.805900 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-4060774d-9844-4ad0-bc89-f2a2a94d159f req-8453cb08-af96-4aec-84a7-6c0af421afea service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.806288 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-4060774d-9844-4ad0-bc89-f2a2a94d159f req-8453cb08-af96-4aec-84a7-6c0af421afea service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.807256 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-4060774d-9844-4ad0-bc89-f2a2a94d159f req-8453cb08-af96-4aec-84a7-6c0af421afea service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.817953 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-4060774d-9844-4ad0-bc89-f2a2a94d159f req-8453cb08-af96-4aec-84a7-6c0af421afea service nova] Creating event network-vif-plugged:cfb5a114-7f09-4646-a431-86f19b7d5378 for instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 on hv-cinder-85144 Aug 10 23:20:40.823777 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-4060774d-9844-4ad0-bc89-f2a2a94d159f req-8453cb08-af96-4aec-84a7-6c0af421afea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030669 Aug 10 23:20:40.824102 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 319/645] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:41.228575 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3947b848-0294-41a4-ae53-c1bb6ba4c438 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:41.229683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3947b848-0294-41a4-ae53-c1bb6ba4c438 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:41.236102 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3947b848-0294-41a4-ae53-c1bb6ba4c438 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:41.236585 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3947b848-0294-41a4-ae53-c1bb6ba4c438 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:41.237019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3947b848-0294-41a4-ae53-c1bb6ba4c438 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:41.237716 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3947b848-0294-41a4-ae53-c1bb6ba4c438 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:41.238168 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3947b848-0294-41a4-ae53-c1bb6ba4c438 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:41.238592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3947b848-0294-41a4-ae53-c1bb6ba4c438 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:41.368132 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3947b848-0294-41a4-ae53-c1bb6ba4c438 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:41.376202 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3947b848-0294-41a4-ae53-c1bb6ba4c438 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1361 microversion: 2.1 time: 0.151504 Aug 10 23:20:41.376769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 327/646] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:41 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:42.397952 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1a2ff3df-db08-4c94-8445-7786a16cc39a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:42.398709 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1a2ff3df-db08-4c94-8445-7786a16cc39a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:42.404983 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a2ff3df-db08-4c94-8445-7786a16cc39a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:42.405575 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a2ff3df-db08-4c94-8445-7786a16cc39a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:42.406022 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a2ff3df-db08-4c94-8445-7786a16cc39a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:42.406763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a2ff3df-db08-4c94-8445-7786a16cc39a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:42.407230 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a2ff3df-db08-4c94-8445-7786a16cc39a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:42.407661 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1a2ff3df-db08-4c94-8445-7786a16cc39a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:42.540146 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1a2ff3df-db08-4c94-8445-7786a16cc39a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:42.547564 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1a2ff3df-db08-4c94-8445-7786a16cc39a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1361 microversion: 2.1 time: 0.154311 Aug 10 23:20:42.548172 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 320/647] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:42 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:43.568625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-64d14279-b535-4966-9020-fd8c41eb489f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:43.569232 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-64d14279-b535-4966-9020-fd8c41eb489f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:43.576158 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d14279-b535-4966-9020-fd8c41eb489f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:43.576638 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d14279-b535-4966-9020-fd8c41eb489f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:43.577070 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d14279-b535-4966-9020-fd8c41eb489f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:43.577757 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d14279-b535-4966-9020-fd8c41eb489f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:43.578207 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d14279-b535-4966-9020-fd8c41eb489f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:43.578627 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d14279-b535-4966-9020-fd8c41eb489f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:43.708555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-64d14279-b535-4966-9020-fd8c41eb489f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:43.716189 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-64d14279-b535-4966-9020-fd8c41eb489f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1547 microversion: 2.1 time: 0.151459 Aug 10 23:20:43.716750 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 328/648] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:43 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:43.736125 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-89d542b1-953c-4663-994a-b623591f26e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:43.736613 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-89d542b1-953c-4663-994a-b623591f26e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:43.743109 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89d542b1-953c-4663-994a-b623591f26e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:43.743585 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89d542b1-953c-4663-994a-b623591f26e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:43.744018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89d542b1-953c-4663-994a-b623591f26e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:43.745217 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89d542b1-953c-4663-994a-b623591f26e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:43.745715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89d542b1-953c-4663-994a-b623591f26e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:43.746089 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89d542b1-953c-4663-994a-b623591f26e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:43.824947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-89d542b1-953c-4663-994a-b623591f26e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092628 Aug 10 23:20:43.825542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 321/649] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 10 23:20:43 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:44.821044 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-210d84d8-6deb-4549-9fdd-20d1310d66ab req-347bda9d-fb0f-46a3-854d-a79b6ea9ae0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ed0bfa-e1e6-429e-b615-567dbbc217a9", "tag": "cfb5a114-7f09-4646-a431-86f19b7d5378"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:44.831410 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-210d84d8-6deb-4549-9fdd-20d1310d66ab req-347bda9d-fb0f-46a3-854d-a79b6ea9ae0c service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:44.831895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-210d84d8-6deb-4549-9fdd-20d1310d66ab req-347bda9d-fb0f-46a3-854d-a79b6ea9ae0c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:44.832333 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-210d84d8-6deb-4549-9fdd-20d1310d66ab req-347bda9d-fb0f-46a3-854d-a79b6ea9ae0c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:44.843292 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-210d84d8-6deb-4549-9fdd-20d1310d66ab req-347bda9d-fb0f-46a3-854d-a79b6ea9ae0c service nova] Creating event network-changed:cfb5a114-7f09-4646-a431-86f19b7d5378 for instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 on hv-cinder-85144 Aug 10 23:20:44.848232 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-210d84d8-6deb-4549-9fdd-20d1310d66ab req-347bda9d-fb0f-46a3-854d-a79b6ea9ae0c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030943 Aug 10 23:20:44.849194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 329/650] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:10.705225 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:10.706117 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=38 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:10.709946 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ebd09036-49c8-4a29-a811-59fd1d130dc1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:10.710439 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ebd09036-49c8-4a29-a811-59fd1d130dc1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:10.717389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ebd09036-49c8-4a29-a811-59fd1d130dc1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:10.722940 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ebd09036-49c8-4a29-a811-59fd1d130dc1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:10.722940 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ebd09036-49c8-4a29-a811-59fd1d130dc1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:10.722940 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ebd09036-49c8-4a29-a811-59fd1d130dc1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:10.722940 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ebd09036-49c8-4a29-a811-59fd1d130dc1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:10.723443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ebd09036-49c8-4a29-a811-59fd1d130dc1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:10.744489 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ebd09036-49c8-4a29-a811-59fd1d130dc1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/ips" status: 200 len: 149 microversion: 2.1 time: 0.041335 Aug 10 23:21:10.745080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 322/651] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 10 23:21:10 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:13.450614 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:13.451404 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=46 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:13.455624 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4bc83caf-fc97-44fa-8106-d61a4c4de176 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36cde9f3-272a-4817-b2f8-ebaefb8de490"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:13.458029 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4bc83caf-fc97-44fa-8106-d61a4c4de176 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:13.464914 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4bc83caf-fc97-44fa-8106-d61a4c4de176 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:13.469621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4bc83caf-fc97-44fa-8106-d61a4c4de176 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:13.469621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4bc83caf-fc97-44fa-8106-d61a4c4de176 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:13.469621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4bc83caf-fc97-44fa-8106-d61a4c4de176 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:13.469621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4bc83caf-fc97-44fa-8106-d61a4c4de176 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:13.470104 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4bc83caf-fc97-44fa-8106-d61a4c4de176 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:14.031538 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4bc83caf-fc97-44fa-8106-d61a4c4de176 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.582309 Aug 10 23:21:14.032297 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 330/652] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:21:13 2022] POST /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:21:21.552387 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36cde9f3-272a-4817-b2f8-ebaefb8de490"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:21.554721 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:21.562111 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.562646 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.563108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.563808 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.564265 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.564694 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.644487 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Invalid volume: volume 36cde9f3-272a-4817-b2f8-ebaefb8de490 is already attached to instances: b54661f9-1a04-4076-9cad-bbef28ed6e3d Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: POST /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments HTTP/1.1 Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 74 Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:21:21.646190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {"volumeAttachment": {"volumeId": "36cde9f3-272a-4817-b2f8-ebaefb8de490"}} Aug 10 23:21:21.648066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Invalid volume: volume 36cde9f3-272a-4817-b2f8-ebaefb8de490 is already attached to instances: b54661f9-1a04-4076-9cad-bbef28ed6e3d Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'server_id': 'b54661f9-1a04-4076-9cad-bbef28ed6e3d', 'body': {'volumeAttachment': {'volumeId': '36cde9f3-272a-4817-b2f8-ebaefb8de490'}}} Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 36cde9f3-272a-4817-b2f8-ebaefb8de490 is already attached to instances: b54661f9-1a04-4076-9cad-bbef28ed6e3d Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:21:21.649173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 36cde9f3-272a-4817-b2f8-ebaefb8de490 is already attached to instances: b54661f9-1a04-4076-9cad-bbef28ed6e3d Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:21.650713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:21.652975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:21.652975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:21.652975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:21.652975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 36cde9f3-272a-4817-b2f8-ebaefb8de490 is already attached to instances: b54661f9-1a04-4076-9cad-bbef28ed6e3d Aug 10 23:21:21.652975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:21:21.652975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 400 to user: Invalid volume: volume 36cde9f3-272a-4817-b2f8-ebaefb8de490 is already attached to instances: b54661f9-1a04-4076-9cad-bbef28ed6e3d {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:21.652975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-391b0dd2-d644-484a-8ba3-6a796316d923 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099653 Aug 10 23:21:21.652975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 323/653] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:21:21 2022] POST /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:21:21.718513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-85a52541-19b4-4d29-9c8b-f4e93a6d7893 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:21.719138 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-85a52541-19b4-4d29-9c8b-f4e93a6d7893 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:21.725240 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85a52541-19b4-4d29-9c8b-f4e93a6d7893 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.725718 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85a52541-19b4-4d29-9c8b-f4e93a6d7893 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.726152 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85a52541-19b4-4d29-9c8b-f4e93a6d7893 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.726873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85a52541-19b4-4d29-9c8b-f4e93a6d7893 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.727325 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85a52541-19b4-4d29-9c8b-f4e93a6d7893 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.727753 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85a52541-19b4-4d29-9c8b-f4e93a6d7893 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.736708 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c01f4379-e086-4b76-8a52-7e5d6a133b16 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:21.737227 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c01f4379-e086-4b76-8a52-7e5d6a133b16 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:21.743150 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c01f4379-e086-4b76-8a52-7e5d6a133b16 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.743560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c01f4379-e086-4b76-8a52-7e5d6a133b16 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.743988 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c01f4379-e086-4b76-8a52-7e5d6a133b16 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.744677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c01f4379-e086-4b76-8a52-7e5d6a133b16 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.745151 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c01f4379-e086-4b76-8a52-7e5d6a133b16 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.745570 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c01f4379-e086-4b76-8a52-7e5d6a133b16 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.771018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c01f4379-e086-4b76-8a52-7e5d6a133b16 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/ips" status: 200 len: 151 microversion: 2.20 time: 0.038087 Aug 10 23:21:21.771605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 324/654] 10.222.0.78 () {60 vars in 1289 bytes} [Wed Aug 10 23:21:21 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:21:21.808181 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-85a52541-19b4-4d29-9c8b-f4e93a6d7893 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lazy-loading 'services' on Instance uuid b54661f9-1a04-4076-9cad-bbef28ed6e3d {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:21:22.015414 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-85a52541-19b4-4d29-9c8b-f4e93a6d7893 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments/36cde9f3-272a-4817-b2f8-ebaefb8de490" status: 202 len: 0 microversion: 2.1 time: 0.301965 Aug 10 23:21:22.016017 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 331/655] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:21:21 2022] DELETE /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments/36cde9f3-272a-4817-b2f8-ebaefb8de490 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:21:22.024622 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-89c179fa-d755-4f71-874d-076c24c6ace0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:22.026891 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-89c179fa-d755-4f71-874d-076c24c6ace0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:22.033380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c179fa-d755-4f71-874d-076c24c6ace0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:22.033866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c179fa-d755-4f71-874d-076c24c6ace0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:22.034304 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c179fa-d755-4f71-874d-076c24c6ace0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:22.035039 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c179fa-d755-4f71-874d-076c24c6ace0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:22.035541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c179fa-d755-4f71-874d-076c24c6ace0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:22.035975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c179fa-d755-4f71-874d-076c24c6ace0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:22.064781 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-89c179fa-d755-4f71-874d-076c24c6ace0 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 Aug 10 23:21:22.065344 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 325/656] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:21:22 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:23.078279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-53bce937-7a75-47a4-9da2-5b9b0a63993f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:23.080537 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-53bce937-7a75-47a4-9da2-5b9b0a63993f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:23.086915 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-53bce937-7a75-47a4-9da2-5b9b0a63993f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:23.087405 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-53bce937-7a75-47a4-9da2-5b9b0a63993f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:23.087847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-53bce937-7a75-47a4-9da2-5b9b0a63993f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:23.088548 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-53bce937-7a75-47a4-9da2-5b9b0a63993f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:23.089016 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-53bce937-7a75-47a4-9da2-5b9b0a63993f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:23.089686 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-53bce937-7a75-47a4-9da2-5b9b0a63993f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:23.118089 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-53bce937-7a75-47a4-9da2-5b9b0a63993f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045194 Aug 10 23:21:23.118681 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 332/657] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:21:23 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:23.931924 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-eb7ac1a8-8fb4-48b5-8c41-2d342bd4fabe tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:23.932550 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-eb7ac1a8-8fb4-48b5-8c41-2d342bd4fabe tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:23.941204 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eb7ac1a8-8fb4-48b5-8c41-2d342bd4fabe tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:23.941838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eb7ac1a8-8fb4-48b5-8c41-2d342bd4fabe tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:23.942109 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eb7ac1a8-8fb4-48b5-8c41-2d342bd4fabe tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:23.942834 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eb7ac1a8-8fb4-48b5-8c41-2d342bd4fabe tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:23.943286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eb7ac1a8-8fb4-48b5-8c41-2d342bd4fabe tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:23.943707 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eb7ac1a8-8fb4-48b5-8c41-2d342bd4fabe tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:23.965926 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-eb7ac1a8-8fb4-48b5-8c41-2d342bd4fabe tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lazy-loading 'flavor' on Instance uuid 40168342-ce20-4df4-9112-60c03c657239 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:21:24.131101 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-dafc0430-8ec1-4792-97f3-57ee001cd9cc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:24.133980 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-dafc0430-8ec1-4792-97f3-57ee001cd9cc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:24.140324 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dafc0430-8ec1-4792-97f3-57ee001cd9cc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.140804 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dafc0430-8ec1-4792-97f3-57ee001cd9cc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.141252 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dafc0430-8ec1-4792-97f3-57ee001cd9cc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.141952 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dafc0430-8ec1-4792-97f3-57ee001cd9cc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.142408 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dafc0430-8ec1-4792-97f3-57ee001cd9cc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.142870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dafc0430-8ec1-4792-97f3-57ee001cd9cc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.170954 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-dafc0430-8ec1-4792-97f3-57ee001cd9cc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043817 Aug 10 23:21:24.171516 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 333/658] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:21:24 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 23:21:24.231678 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-bc70feeb-6589-47bb-ab8d-e4ff06b28d8c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:24.232184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bc70feeb-6589-47bb-ab8d-e4ff06b28d8c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:24.238103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bc70feeb-6589-47bb-ab8d-e4ff06b28d8c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.244477 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bc70feeb-6589-47bb-ab8d-e4ff06b28d8c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.244477 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bc70feeb-6589-47bb-ab8d-e4ff06b28d8c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.244477 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bc70feeb-6589-47bb-ab8d-e4ff06b28d8c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.244477 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bc70feeb-6589-47bb-ab8d-e4ff06b28d8c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.244991 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bc70feeb-6589-47bb-ab8d-e4ff06b28d8c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.265451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bc70feeb-6589-47bb-ab8d-e4ff06b28d8c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:21:24.454891 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-eb7ac1a8-8fb4-48b5-8c41-2d342bd4fabe tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "POST /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/action" status: 202 len: 0 microversion: 2.20 time: 0.526633 Aug 10 23:21:24.455513 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 326/659] 10.222.0.78 () {62 vars in 1319 bytes} [Wed Aug 10 23:21:23 2022] POST /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:21:24.465135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:24.476330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:24.476330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.476330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.476330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.476756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.476756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.476756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.586889 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-bc70feeb-6589-47bb-ab8d-e4ff06b28d8c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 204 len: 0 microversion: 2.1 time: 0.359195 Aug 10 23:21:24.587581 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 334/660] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:21:24 2022] DELETE /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:21:24.596741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f4a888cb-175e-4a69-afd3-95bbdd072d0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:24.597531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f4a888cb-175e-4a69-afd3-95bbdd072d0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:24.603855 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f4a888cb-175e-4a69-afd3-95bbdd072d0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.604511 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f4a888cb-175e-4a69-afd3-95bbdd072d0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.605530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f4a888cb-175e-4a69-afd3-95bbdd072d0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.606244 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f4a888cb-175e-4a69-afd3-95bbdd072d0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.606719 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f4a888cb-175e-4a69-afd3-95bbdd072d0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.607148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f4a888cb-175e-4a69-afd3-95bbdd072d0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.615106 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:24.623302 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:24.628626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:24.628626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e5c9f270-c962-438b-a3d1-6379913cb316 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.165694 Aug 10 23:21:24.628626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 327/661] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:24 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:24.743488 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f4a888cb-175e-4a69-afd3-95bbdd072d0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:24.751503 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f4a888cb-175e-4a69-afd3-95bbdd072d0f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1681 microversion: 2.1 time: 0.158854 Aug 10 23:21:24.760521 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 335/662] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:24 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:25.649279 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:25.649889 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:25.656418 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:25.656899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:25.657336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:25.658029 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:25.658513 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:25.658966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:25.771824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0c0185ca-aada-4b7c-a994-761c8bd71254 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:25.772430 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0c0185ca-aada-4b7c-a994-761c8bd71254 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:25.779295 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0c0185ca-aada-4b7c-a994-761c8bd71254 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:25.779768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0c0185ca-aada-4b7c-a994-761c8bd71254 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:25.780197 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0c0185ca-aada-4b7c-a994-761c8bd71254 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:25.780878 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0c0185ca-aada-4b7c-a994-761c8bd71254 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:25.781324 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0c0185ca-aada-4b7c-a994-761c8bd71254 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:25.781838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0c0185ca-aada-4b7c-a994-761c8bd71254 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:25.788722 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:25.797226 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:25.798795 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:25.799953 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-10315812-7905-48e1-bef2-eecc36d2e6a8 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.154595 Aug 10 23:21:25.800504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 328/663] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:25 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:25.910517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0c0185ca-aada-4b7c-a994-761c8bd71254 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:25.917874 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0c0185ca-aada-4b7c-a994-761c8bd71254 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1681 microversion: 2.1 time: 0.149876 Aug 10 23:21:25.918438 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 336/664] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:25 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:26.822445 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:26.823066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:26.830260 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:26.830765 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:26.831196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:26.831904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:26.832344 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:26.832762 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:26.939960 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5195085c-f4ab-48ad-8fa6-0deda58a04eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:26.940338 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5195085c-f4ab-48ad-8fa6-0deda58a04eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:26.946991 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5195085c-f4ab-48ad-8fa6-0deda58a04eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:26.947470 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5195085c-f4ab-48ad-8fa6-0deda58a04eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:26.947902 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5195085c-f4ab-48ad-8fa6-0deda58a04eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:26.948603 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5195085c-f4ab-48ad-8fa6-0deda58a04eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:26.949040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5195085c-f4ab-48ad-8fa6-0deda58a04eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:26.949460 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5195085c-f4ab-48ad-8fa6-0deda58a04eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:27.064477 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:27.071904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:27.073391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:27.074543 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-51f4cf4b-1695-4ba7-8046-e1b0d15db47c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.256005 Aug 10 23:21:27.075142 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 329/665] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:26 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:27.171938 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5195085c-f4ab-48ad-8fa6-0deda58a04eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:27.180122 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5195085c-f4ab-48ad-8fa6-0deda58a04eb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1681 microversion: 2.1 time: 0.244515 Aug 10 23:21:27.180769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 337/666] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:26 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:27.877053 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-015bc551-a8c1-4864-818f-db4390cc02f3 req-5f8f11ab-e950-405f-9eb4-723627431d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54661f9-1a04-4076-9cad-bbef28ed6e3d", "name": "network-vif-deleted", "tag": "1c047fed-fd6b-486e-865f-6dd6859da484"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:27.888244 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-015bc551-a8c1-4864-818f-db4390cc02f3 req-5f8f11ab-e950-405f-9eb4-723627431d11 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:27.888701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-015bc551-a8c1-4864-818f-db4390cc02f3 req-5f8f11ab-e950-405f-9eb4-723627431d11 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:27.889122 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-015bc551-a8c1-4864-818f-db4390cc02f3 req-5f8f11ab-e950-405f-9eb4-723627431d11 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:27.900841 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-015bc551-a8c1-4864-818f-db4390cc02f3 req-5f8f11ab-e950-405f-9eb4-723627431d11 service nova] Creating event network-vif-deleted:1c047fed-fd6b-486e-865f-6dd6859da484 for instance b54661f9-1a04-4076-9cad-bbef28ed6e3d on hv-cinder-85144 Aug 10 23:21:27.905860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-015bc551-a8c1-4864-818f-db4390cc02f3 req-5f8f11ab-e950-405f-9eb4-723627431d11 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032939 Aug 10 23:21:27.906402 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 330/667] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:28.097827 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:28.098790 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:28.106261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:28.106794 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:28.107235 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:28.107949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:28.108406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:28.108838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:28.202896 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:28.203911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:28.211370 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:28.212086 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:28.213500 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:28.213500 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:28.214706 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:28.215179 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:28.255340 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:28.255646 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:28.256172 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:28.256339 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:28.256699 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lazy-loading 'fault' on Instance uuid b54661f9-1a04-4076-9cad-bbef28ed6e3d {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:21:28.265403 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:28.267214 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:28.268394 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-951a9524-b06c-44d4-a176-6b05051cf6c3 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.174401 Aug 10 23:21:28.268955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 338/668] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:28 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:28.305874 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:28.313805 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f532a347-aad9-49c3-a465-85eaee94b2b6 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 200 len: 1332 microversion: 2.1 time: 0.116114 Aug 10 23:21:28.314370 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 331/669] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:28 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:29.292225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:29.292774 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:29.299107 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:29.299607 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:29.300018 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:29.300699 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:29.301147 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:29.301566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:29.335477 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:29.336090 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:29.342687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:29.343189 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:29.343625 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:29.344338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:29.344787 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:29.345210 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:29.358721 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d HTTP/1.1 Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:21:29.360395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:21:29.362005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'b54661f9-1a04-4076-9cad-bbef28ed6e3d'} Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:29.362875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:21:29.364334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:21:29.365794 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:29.365794 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-110e3d6f-e3e5-418d-bea8-cb6a7b48f9fa tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 404 len: 111 microversion: 2.1 time: 0.030725 Aug 10 23:21:29.365794 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 332/670] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:29 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:21:29.370715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-45809136-8224-43d9-978e-216e4db61248 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '.version_select at 0x7fe840585820>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:29.434493 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:29.442529 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:29.444097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:29.445256 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-17e2d6af-d4eb-4082-bccb-afebd9ecdb7d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.157011 Aug 10 23:21:29.445812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 339/671] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:29 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:29.496461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-45809136-8224-43d9-978e-216e4db61248 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514564441" status: 202 len: 0 microversion: 2.1 time: 0.129341 Aug 10 23:21:29.497043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 333/672] 10.222.0.78 () {58 vars in 1221 bytes} [Wed Aug 10 23:21:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514564441 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:21:30.338460 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d9ba4e9f-370d-460e-b445-cf02da68e392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: .version_select at 0x7fe833e7d280>, body: {"keypair": {"name": "tempest-keypair-796517397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE6I4OWc077j/5VSrgXS6a/56zVfYyruMXH3SfLTc9hfSP3RaRGC7OF8cXRKJGSPw+V2yaHCmsRssdu/HB026IY8extAusm+pCXe2Q6c9DQDvMWvhU52oEliVahNXgXYg=="}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:30.354691 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-d9ba4e9f-370d-460e-b445-cf02da68e392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:21:30.358879 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-d9ba4e9f-370d-460e-b445-cf02da68e392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for user 22e92975af1d439f88e33cc494c88b1f and project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:21:30.468603 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d9ba4e9f-370d-460e-b445-cf02da68e392 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133916 Aug 10 23:21:30.469545 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 340/673] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 10 23:21:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:30.476178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:30.476786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:30.484086 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:30.484569 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:30.485002 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:30.485915 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:30.486369 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:30.486887 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:30.655778 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:30.663715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:30.666293 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:30.666434 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e920b143-6718-4ccc-99e9-63e844132542 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.201107 Aug 10 23:21:30.682622 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 334/674] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:30 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:31.690564 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:31.691207 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:31.697776 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:31.698262 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:31.698766 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:31.699472 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:31.699926 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:31.700353 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:31.892595 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:31.901071 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:31.903179 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:31.904384 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a14d2c87-23ce-40b3-b2fa-34d7e16eb47b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.218241 Aug 10 23:21:31.904959 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 341/675] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:31 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:32.777620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-427319690", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ce4c9a7-fd4e-4da4-add0-101e1cd65acd"}], "security_groups": [{"name": "tempest-securitygroup--1168350723"}], "key_name": "tempest-keypair-796517397", "user_data": "}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:32.884319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] validate_networks() for [('5ce4c9a7-fd4e-4da4-add0-101e1cd65acd', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:21:32.928017 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:32.928931 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:32.936298 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:32.936775 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:32.937204 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:32.937906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:32.938351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:32.938938 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:33.138566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:33.146889 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:33.148702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:33.149847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ed04585a-b407-4d14-8c52-cd78bfa27b23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.225883 Aug 10 23:21:33.150403 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 342/676] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:32 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:33.308426 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:21:33.308851 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:21:33.309358 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:21:33.309774 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:21:33.310218 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:21:33.319178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:33.319662 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:33.320105 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:33.320842 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:33.321300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:33.321729 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:33.338615 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:21:33.343167 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Getting quotas for user 22e92975af1d439f88e33cc494c88b1f and project 6da31a6c1eb84fa1aaf256037c8848e0. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:21:33.354113 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:21:33.356433 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:21:33.469449 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-72df44aa-bd11-44f1-a2ba-1cec48b7e8e2 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.696502 Aug 10 23:21:33.470101 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 335/677] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:21:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:21:33.480908 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0cfeb42f-6964-4c71-ae62-a63e95468bc5 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:33.481668 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0cfeb42f-6964-4c71-ae62-a63e95468bc5 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:33.533816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0cfeb42f-6964-4c71-ae62-a63e95468bc5 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:33.540701 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0cfeb42f-6964-4c71-ae62-a63e95468bc5 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1240 microversion: 2.1 time: 0.063589 Aug 10 23:21:33.541281 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 343/678] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:33 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:34.178500 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:34.179172 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:34.186543 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:34.187056 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:34.187491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:34.188190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:34.188645 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:34.189071 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:34.319126 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:34.327188 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:34.328723 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:34.329875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e3946a25-53c5-40d7-b24e-f44f9728db51 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.155909 Aug 10 23:21:34.330429 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 336/679] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:34 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:21:34.561662 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5721a89a-5376-453a-a90a-dda913747110 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:34.562277 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5721a89a-5376-453a-a90a-dda913747110 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:34.568850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5721a89a-5376-453a-a90a-dda913747110 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:34.569333 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5721a89a-5376-453a-a90a-dda913747110 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:34.569775 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5721a89a-5376-453a-a90a-dda913747110 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:34.570473 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5721a89a-5376-453a-a90a-dda913747110 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:34.570969 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5721a89a-5376-453a-a90a-dda913747110 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:34.571441 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5721a89a-5376-453a-a90a-dda913747110 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:34.632661 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5721a89a-5376-453a-a90a-dda913747110 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:34.636174 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:34.640472 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5721a89a-5376-453a-a90a-dda913747110 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1244 microversion: 2.1 time: 0.082696 Aug 10 23:21:34.641036 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 344/680] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:34 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:35.352978 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:35.353582 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:35.359804 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:35.360284 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:35.360719 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:35.361427 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:35.361889 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:35.362315 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:35.493325 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:35.501617 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:35.503159 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:35.504310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4cd4ce9f-ffeb-4f70-8ad3-9ab6f4907d29 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.155296 Aug 10 23:21:35.504866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 337/681] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:35 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:35.661767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-319e5c10-4561-4ca7-8c23-a69d01c9255c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:35.662386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-319e5c10-4561-4ca7-8c23-a69d01c9255c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:35.669769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-319e5c10-4561-4ca7-8c23-a69d01c9255c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:35.670252 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-319e5c10-4561-4ca7-8c23-a69d01c9255c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:35.670726 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-319e5c10-4561-4ca7-8c23-a69d01c9255c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:35.671427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-319e5c10-4561-4ca7-8c23-a69d01c9255c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:35.671885 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-319e5c10-4561-4ca7-8c23-a69d01c9255c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:35.672315 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-319e5c10-4561-4ca7-8c23-a69d01c9255c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:35.737269 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-319e5c10-4561-4ca7-8c23-a69d01c9255c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:35.741980 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-319e5c10-4561-4ca7-8c23-a69d01c9255c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1292 microversion: 2.1 time: 0.084424 Aug 10 23:21:35.742556 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 345/682] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:35 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:36.527680 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:36.528298 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:36.534786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:36.535267 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:36.535704 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:36.536401 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:36.536854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:36.537279 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:36.715412 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:36.723273 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:36.724812 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:36.725968 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-216aa7e7-56fd-4bb3-9187-9dbf1d181008 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1745 microversion: 2.20 time: 0.202237 Aug 10 23:21:36.726701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 338/683] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:36 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1745 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:36.763705 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-bcddc69c-2c5d-4381-bb37-39d076513fbc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:36.764620 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bcddc69c-2c5d-4381-bb37-39d076513fbc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:36.771117 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bcddc69c-2c5d-4381-bb37-39d076513fbc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:36.771608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bcddc69c-2c5d-4381-bb37-39d076513fbc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:36.772047 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bcddc69c-2c5d-4381-bb37-39d076513fbc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:36.772755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bcddc69c-2c5d-4381-bb37-39d076513fbc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:36.773207 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bcddc69c-2c5d-4381-bb37-39d076513fbc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:36.773635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bcddc69c-2c5d-4381-bb37-39d076513fbc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:36.963249 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-bcddc69c-2c5d-4381-bb37-39d076513fbc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:36.971737 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-bcddc69c-2c5d-4381-bb37-39d076513fbc tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1366 microversion: 2.1 time: 0.212246 Aug 10 23:21:36.972311 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 346/684] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:36 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:37.751626 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:37.754638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-39baadb8-5ba2-47fe-8997-0c3911207871 req-61fa9b08-4a63-4cae-b3a4-2179b2bb4c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4400e6b6-97d1-400f-9a8d-2c9db7c77042", "tag": "72395218-a18f-4a02-bea7-28b6142da97e"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:37.755183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:37.759897 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:37.760382 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:37.760814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:37.762193 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:37.762810 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-39baadb8-5ba2-47fe-8997-0c3911207871 req-61fa9b08-4a63-4cae-b3a4-2179b2bb4c88 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:37.762959 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:37.763284 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-39baadb8-5ba2-47fe-8997-0c3911207871 req-61fa9b08-4a63-4cae-b3a4-2179b2bb4c88 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:37.763399 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:37.763710 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-39baadb8-5ba2-47fe-8997-0c3911207871 req-61fa9b08-4a63-4cae-b3a4-2179b2bb4c88 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:37.775642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-39baadb8-5ba2-47fe-8997-0c3911207871 req-61fa9b08-4a63-4cae-b3a4-2179b2bb4c88 service nova] Creating event network-changed:72395218-a18f-4a02-bea7-28b6142da97e for instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 on hv-cinder-85144 Aug 10 23:21:37.780614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-39baadb8-5ba2-47fe-8997-0c3911207871 req-61fa9b08-4a63-4cae-b3a4-2179b2bb4c88 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032642 Aug 10 23:21:37.781245 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 339/685] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:37.981133 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:37.989520 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:37.991067 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:37.992238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7042ca5f-d338-4788-b7ed-3efb51d447ff tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1745 microversion: 2.20 time: 0.244502 Aug 10 23:21:37.992949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 347/686] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:37 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1745 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:37.994780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a545159d-5f6a-41fa-a8a8-d9e52407827f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:37.995588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a545159d-5f6a-41fa-a8a8-d9e52407827f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:38.002772 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a545159d-5f6a-41fa-a8a8-d9e52407827f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:38.003512 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a545159d-5f6a-41fa-a8a8-d9e52407827f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:38.004165 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a545159d-5f6a-41fa-a8a8-d9e52407827f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:38.004872 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a545159d-5f6a-41fa-a8a8-d9e52407827f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:38.005324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a545159d-5f6a-41fa-a8a8-d9e52407827f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:38.005747 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a545159d-5f6a-41fa-a8a8-d9e52407827f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:38.023297 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:38.196048 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a545159d-5f6a-41fa-a8a8-d9e52407827f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:38.203690 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a545159d-5f6a-41fa-a8a8-d9e52407827f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1366 microversion: 2.1 time: 0.213928 Aug 10 23:21:38.204261 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 340/687] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:37 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:39.016459 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:39.017084 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:39.023486 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.023720 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.024162 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.024878 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.025335 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.025765 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.152238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:39.160165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:39.161711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:39.162907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2ee9563b-16c3-410e-9374-f7abf84f95c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1745 microversion: 2.20 time: 0.150359 Aug 10 23:21:39.163501 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 348/688] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:39 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:39.224735 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0957c744-9813-451f-b2e8-fd04f14d102c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:39.225353 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0957c744-9813-451f-b2e8-fd04f14d102c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:39.231809 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0957c744-9813-451f-b2e8-fd04f14d102c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.232289 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0957c744-9813-451f-b2e8-fd04f14d102c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.232728 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0957c744-9813-451f-b2e8-fd04f14d102c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.233427 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0957c744-9813-451f-b2e8-fd04f14d102c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.233886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0957c744-9813-451f-b2e8-fd04f14d102c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.234313 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0957c744-9813-451f-b2e8-fd04f14d102c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.361114 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0957c744-9813-451f-b2e8-fd04f14d102c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:39.370649 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0957c744-9813-451f-b2e8-fd04f14d102c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1366 microversion: 2.1 time: 0.149546 Aug 10 23:21:39.371804 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 341/689] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:39 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:39.458917 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-463dcbd4-8e02-4ba3-89e8-bc50f5abfa49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:39.459518 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-463dcbd4-8e02-4ba3-89e8-bc50f5abfa49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:39.465786 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-463dcbd4-8e02-4ba3-89e8-bc50f5abfa49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.466261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-463dcbd4-8e02-4ba3-89e8-bc50f5abfa49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.466716 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-463dcbd4-8e02-4ba3-89e8-bc50f5abfa49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.467403 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-463dcbd4-8e02-4ba3-89e8-bc50f5abfa49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.467850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-463dcbd4-8e02-4ba3-89e8-bc50f5abfa49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.468270 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-463dcbd4-8e02-4ba3-89e8-bc50f5abfa49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.491074 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-463dcbd4-8e02-4ba3-89e8-bc50f5abfa49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lazy-loading 'flavor' on Instance uuid ace5e95d-7b24-4111-ae18-7185b8662c79 {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:21:39.798726 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-463dcbd4-8e02-4ba3-89e8-bc50f5abfa49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "POST /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79/action" status: 202 len: 0 microversion: 2.1 time: 0.343628 Aug 10 23:21:39.799655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 349/690] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:21:39 2022] POST /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:21:39.810270 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9fbe73af-774a-4f75-97b6-89111caf6992 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:39.811135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9fbe73af-774a-4f75-97b6-89111caf6992 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:39.818280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9fbe73af-774a-4f75-97b6-89111caf6992 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.818805 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9fbe73af-774a-4f75-97b6-89111caf6992 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.819244 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9fbe73af-774a-4f75-97b6-89111caf6992 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.819953 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9fbe73af-774a-4f75-97b6-89111caf6992 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.820407 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9fbe73af-774a-4f75-97b6-89111caf6992 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.820839 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9fbe73af-774a-4f75-97b6-89111caf6992 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.961698 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9fbe73af-774a-4f75-97b6-89111caf6992 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:39.969438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9fbe73af-774a-4f75-97b6-89111caf6992 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.164435 Aug 10 23:21:39.970067 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 342/691] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:39 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:40.187404 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:40.188104 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:40.194204 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:40.194723 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:40.195161 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:40.195854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:40.196306 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:40.196731 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:40.325778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:40.333638 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:40.335186 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:40.336329 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7b6e2ca5-c1ec-4b53-ad83-0791b3493fb4 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1745 microversion: 2.20 time: 0.154288 Aug 10 23:21:40.336887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 350/692] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:40 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:40.390904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5b285f6d-5306-4749-a720-a5bf59a029c3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:40.391518 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5b285f6d-5306-4749-a720-a5bf59a029c3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:40.398052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b285f6d-5306-4749-a720-a5bf59a029c3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:40.398532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b285f6d-5306-4749-a720-a5bf59a029c3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:40.399078 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b285f6d-5306-4749-a720-a5bf59a029c3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:40.399768 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b285f6d-5306-4749-a720-a5bf59a029c3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:40.400218 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b285f6d-5306-4749-a720-a5bf59a029c3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:40.400639 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b285f6d-5306-4749-a720-a5bf59a029c3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:40.555364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5b285f6d-5306-4749-a720-a5bf59a029c3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:40.562811 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5b285f6d-5306-4749-a720-a5bf59a029c3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1366 microversion: 2.1 time: 0.175698 Aug 10 23:21:40.563383 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 343/693] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:40 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:40.862601 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-4c082c85-bc70-43ee-b302-0b76786dca94 req-a9953083-caef-46cc-8415-57ebc77ac4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40168342-ce20-4df4-9112-60c03c657239", "name": "network-vif-plugged", "status": "completed", "tag": "33300b87-970b-4a82-b42e-51c6998b535a"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:40.872095 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-4c082c85-bc70-43ee-b302-0b76786dca94 req-a9953083-caef-46cc-8415-57ebc77ac4f7 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:40.872579 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-4c082c85-bc70-43ee-b302-0b76786dca94 req-a9953083-caef-46cc-8415-57ebc77ac4f7 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:40.873013 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-4c082c85-bc70-43ee-b302-0b76786dca94 req-a9953083-caef-46cc-8415-57ebc77ac4f7 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:40.883785 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-4c082c85-bc70-43ee-b302-0b76786dca94 req-a9953083-caef-46cc-8415-57ebc77ac4f7 service nova] Creating event network-vif-plugged:33300b87-970b-4a82-b42e-51c6998b535a for instance 40168342-ce20-4df4-9112-60c03c657239 on hv-cinder-85144 Aug 10 23:21:40.889063 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-4c082c85-bc70-43ee-b302-0b76786dca94 req-a9953083-caef-46cc-8415-57ebc77ac4f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030140 Aug 10 23:21:40.889644 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 351/694] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:40.990536 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0fc68cd9-7042-4094-8294-9cb65ca61679 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:40.991187 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0fc68cd9-7042-4094-8294-9cb65ca61679 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:40.997032 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0fc68cd9-7042-4094-8294-9cb65ca61679 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:40.997514 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0fc68cd9-7042-4094-8294-9cb65ca61679 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:40.997961 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0fc68cd9-7042-4094-8294-9cb65ca61679 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:40.998714 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0fc68cd9-7042-4094-8294-9cb65ca61679 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:40.999180 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0fc68cd9-7042-4094-8294-9cb65ca61679 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:40.999603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0fc68cd9-7042-4094-8294-9cb65ca61679 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:41.128079 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0fc68cd9-7042-4094-8294-9cb65ca61679 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:41.135772 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0fc68cd9-7042-4094-8294-9cb65ca61679 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.149117 Aug 10 23:21:41.136898 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 344/695] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:40 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:41.360437 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:41.361133 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:41.367235 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:41.367713 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:41.368149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:41.368840 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:41.369292 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:41.369716 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:41.498479 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:41.506509 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:41.508013 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:41.509249 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0635fd83-d1c6-4f56-8653-3fdd5bc022c9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1745 microversion: 2.20 time: 0.153493 Aug 10 23:21:41.509799 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 352/696] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:41 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:41.583105 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-928edd09-fc6d-4553-9314-190ff996566c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:41.583712 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-928edd09-fc6d-4553-9314-190ff996566c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:41.590530 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-928edd09-fc6d-4553-9314-190ff996566c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:41.591051 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-928edd09-fc6d-4553-9314-190ff996566c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:41.591495 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-928edd09-fc6d-4553-9314-190ff996566c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:41.592202 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-928edd09-fc6d-4553-9314-190ff996566c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:41.592662 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-928edd09-fc6d-4553-9314-190ff996566c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:41.593091 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-928edd09-fc6d-4553-9314-190ff996566c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:41.721577 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-928edd09-fc6d-4553-9314-190ff996566c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:41.728916 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-928edd09-fc6d-4553-9314-190ff996566c tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1366 microversion: 2.1 time: 0.149642 Aug 10 23:21:41.729460 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 345/697] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:41 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:42.156677 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f0a1d032-e944-4db3-a927-81617fab2778 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:42.157319 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f0a1d032-e944-4db3-a927-81617fab2778 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:42.163364 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f0a1d032-e944-4db3-a927-81617fab2778 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:42.163835 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f0a1d032-e944-4db3-a927-81617fab2778 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:42.164271 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f0a1d032-e944-4db3-a927-81617fab2778 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:42.164969 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f0a1d032-e944-4db3-a927-81617fab2778 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:42.165445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f0a1d032-e944-4db3-a927-81617fab2778 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:42.165869 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f0a1d032-e944-4db3-a927-81617fab2778 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:42.298937 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f0a1d032-e944-4db3-a927-81617fab2778 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:42.306497 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f0a1d032-e944-4db3-a927-81617fab2778 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.153765 Aug 10 23:21:42.307973 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 353/698] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:42 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:42.531980 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:42.532661 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:42.538935 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:42.539420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:42.539856 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:42.541365 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:42.542013 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:42.542981 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:42.674424 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:42.682545 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:42.684616 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:42.685760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5e1f7399-967a-41fb-ab3a-ef50b4ff75af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1745 microversion: 2.20 time: 0.157763 Aug 10 23:21:42.686314 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 346/699] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:42 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:42.749404 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-854fdaab-c356-4054-a747-78cd344e1469 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:42.750189 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-854fdaab-c356-4054-a747-78cd344e1469 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:42.756690 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-854fdaab-c356-4054-a747-78cd344e1469 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:42.757198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-854fdaab-c356-4054-a747-78cd344e1469 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:42.757620 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-854fdaab-c356-4054-a747-78cd344e1469 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:42.758318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-854fdaab-c356-4054-a747-78cd344e1469 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:42.758803 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-854fdaab-c356-4054-a747-78cd344e1469 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:42.759239 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-854fdaab-c356-4054-a747-78cd344e1469 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:42.894855 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-854fdaab-c356-4054-a747-78cd344e1469 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:42.902826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-854fdaab-c356-4054-a747-78cd344e1469 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1366 microversion: 2.1 time: 0.157254 Aug 10 23:21:42.903407 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 354/700] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:42 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:43.329184 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4b5dca62-3eec-4a59-b30e-69698f28d9eb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:43.330759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4b5dca62-3eec-4a59-b30e-69698f28d9eb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:43.338757 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:43.343268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b5dca62-3eec-4a59-b30e-69698f28d9eb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:43.343268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b5dca62-3eec-4a59-b30e-69698f28d9eb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:43.343268 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b5dca62-3eec-4a59-b30e-69698f28d9eb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:43.344345 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b5dca62-3eec-4a59-b30e-69698f28d9eb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:43.345395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b5dca62-3eec-4a59-b30e-69698f28d9eb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:43.346360 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4b5dca62-3eec-4a59-b30e-69698f28d9eb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:43.349327 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=6 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:43.591985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4b5dca62-3eec-4a59-b30e-69698f28d9eb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:43.603371 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4b5dca62-3eec-4a59-b30e-69698f28d9eb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.278160 Aug 10 23:21:43.617478 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 347/701] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:43 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:43.708830 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:43.709471 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:43.712743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=6 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:43.713417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:43.717577 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:43.718059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:43.718492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:43.719238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:43.719674 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:43.720097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:43.923922 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c4090e06-4038-45c7-9ff4-9ad693739255 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:43.924571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c4090e06-4038-45c7-9ff4-9ad693739255 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:43.930491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4090e06-4038-45c7-9ff4-9ad693739255 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:43.931309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4090e06-4038-45c7-9ff4-9ad693739255 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:43.931620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4090e06-4038-45c7-9ff4-9ad693739255 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:43.932387 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4090e06-4038-45c7-9ff4-9ad693739255 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:43.932762 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4090e06-4038-45c7-9ff4-9ad693739255 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:43.933188 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c4090e06-4038-45c7-9ff4-9ad693739255 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:43.953436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:43.965815 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:43.968115 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:43.969615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-44ee82aa-eee0-49fb-bd85-81b618c4948a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1740 microversion: 2.20 time: 0.264599 Aug 10 23:21:43.982955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 355/702] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:43 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:44.439776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c4090e06-4038-45c7-9ff4-9ad693739255 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:44.448839 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c4090e06-4038-45c7-9ff4-9ad693739255 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1366 microversion: 2.1 time: 0.528424 Aug 10 23:21:44.463222 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 348/703] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:43 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1366 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:44.625890 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e438b346-b61f-481f-92a8-55b303d755e6 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:44.626503 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e438b346-b61f-481f-92a8-55b303d755e6 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:44.633845 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e438b346-b61f-481f-92a8-55b303d755e6 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:44.634340 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e438b346-b61f-481f-92a8-55b303d755e6 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:44.634814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e438b346-b61f-481f-92a8-55b303d755e6 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:44.635539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e438b346-b61f-481f-92a8-55b303d755e6 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:44.636001 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e438b346-b61f-481f-92a8-55b303d755e6 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:44.636466 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e438b346-b61f-481f-92a8-55b303d755e6 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:44.784746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e438b346-b61f-481f-92a8-55b303d755e6 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:44.793464 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e438b346-b61f-481f-92a8-55b303d755e6 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.171407 Aug 10 23:21:44.794213 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 356/704] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:44 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:44.962630 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-a425f6ea-56d0-41ea-837a-4444ffa83534 req-20f1a0a3-eb96-44b4-962b-2c50d4960b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4400e6b6-97d1-400f-9a8d-2c9db7c77042", "name": "network-vif-plugged", "status": "completed", "tag": "72395218-a18f-4a02-bea7-28b6142da97e"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:44.975258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-a425f6ea-56d0-41ea-837a-4444ffa83534 req-20f1a0a3-eb96-44b4-962b-2c50d4960b49 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:44.975742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-a425f6ea-56d0-41ea-837a-4444ffa83534 req-20f1a0a3-eb96-44b4-962b-2c50d4960b49 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:44.976175 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-a425f6ea-56d0-41ea-837a-4444ffa83534 req-20f1a0a3-eb96-44b4-962b-2c50d4960b49 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:44.989043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-a425f6ea-56d0-41ea-837a-4444ffa83534 req-20f1a0a3-eb96-44b4-962b-2c50d4960b49 service nova] Creating event network-vif-plugged:72395218-a18f-4a02-bea7-28b6142da97e for instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 on hv-cinder-85144 Aug 10 23:21:44.994896 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:44.995706 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-a425f6ea-56d0-41ea-837a-4444ffa83534 req-20f1a0a3-eb96-44b4-962b-2c50d4960b49 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036576 Aug 10 23:21:44.996245 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:44.996670 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 349/705] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:21:45.005261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.005924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.011635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.012522 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.013119 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.013781 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.220227 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:45.228981 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:45.231445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:45.232523 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6221e739-0189-48c6-9e6a-383c6fe234f7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1740 microversion: 2.20 time: 0.242991 Aug 10 23:21:45.233080 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 357/706] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:44 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:45.472334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5af4a916-134d-4a4a-87f7-23aa1f5e802a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:45.473117 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5af4a916-134d-4a4a-87f7-23aa1f5e802a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:45.481345 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5af4a916-134d-4a4a-87f7-23aa1f5e802a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.481864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5af4a916-134d-4a4a-87f7-23aa1f5e802a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.482301 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5af4a916-134d-4a4a-87f7-23aa1f5e802a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.483080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5af4a916-134d-4a4a-87f7-23aa1f5e802a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.483511 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5af4a916-134d-4a4a-87f7-23aa1f5e802a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.486093 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5af4a916-134d-4a4a-87f7-23aa1f5e802a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.655300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5af4a916-134d-4a4a-87f7-23aa1f5e802a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:45.665459 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5af4a916-134d-4a4a-87f7-23aa1f5e802a tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1366 microversion: 2.1 time: 0.198957 Aug 10 23:21:45.666278 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 350/707] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:45 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:45.821349 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0f8b7a5e-aa2f-4637-af9d-411686a62524 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:45.822117 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0f8b7a5e-aa2f-4637-af9d-411686a62524 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:45.831949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a5e-aa2f-4637-af9d-411686a62524 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.832628 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a5e-aa2f-4637-af9d-411686a62524 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.837010 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a5e-aa2f-4637-af9d-411686a62524 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.838208 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a5e-aa2f-4637-af9d-411686a62524 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.838825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a5e-aa2f-4637-af9d-411686a62524 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.839790 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a5e-aa2f-4637-af9d-411686a62524 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:46.027273 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0f8b7a5e-aa2f-4637-af9d-411686a62524 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:46.036825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0f8b7a5e-aa2f-4637-af9d-411686a62524 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.224674 Aug 10 23:21:46.037967 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 358/708] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:45 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:46.257612 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:46.258992 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:46.265954 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:46.266754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:46.267194 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:46.267904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:46.268366 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:46.268793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:46.434604 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:46.448940 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:46.453053 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:46.454252 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f07c6924-3467-4749-9662-90a65d47f21f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1740 microversion: 2.20 time: 0.200921 Aug 10 23:21:46.458744 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 351/709] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:46 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:46.687409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2e7fd0f2-73cd-4c73-aafa-c7fd19c8b5d7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:46.688088 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2e7fd0f2-73cd-4c73-aafa-c7fd19c8b5d7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:46.694202 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e7fd0f2-73cd-4c73-aafa-c7fd19c8b5d7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:46.694708 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e7fd0f2-73cd-4c73-aafa-c7fd19c8b5d7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:46.695149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e7fd0f2-73cd-4c73-aafa-c7fd19c8b5d7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:46.695853 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e7fd0f2-73cd-4c73-aafa-c7fd19c8b5d7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:46.696306 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e7fd0f2-73cd-4c73-aafa-c7fd19c8b5d7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:46.696734 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e7fd0f2-73cd-4c73-aafa-c7fd19c8b5d7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:46.847548 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2e7fd0f2-73cd-4c73-aafa-c7fd19c8b5d7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:46.857772 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2e7fd0f2-73cd-4c73-aafa-c7fd19c8b5d7 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1366 microversion: 2.1 time: 0.175161 Aug 10 23:21:46.858535 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 359/710] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:46 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:47.059075 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e49b3c57-7211-48aa-81ce-b1e4c98a4553 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:47.060526 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e49b3c57-7211-48aa-81ce-b1e4c98a4553 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:47.068292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e49b3c57-7211-48aa-81ce-b1e4c98a4553 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.069078 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e49b3c57-7211-48aa-81ce-b1e4c98a4553 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.069866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e49b3c57-7211-48aa-81ce-b1e4c98a4553 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.071021 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e49b3c57-7211-48aa-81ce-b1e4c98a4553 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.071542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e49b3c57-7211-48aa-81ce-b1e4c98a4553 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.071968 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e49b3c57-7211-48aa-81ce-b1e4c98a4553 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.247878 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e49b3c57-7211-48aa-81ce-b1e4c98a4553 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:47.256466 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e49b3c57-7211-48aa-81ce-b1e4c98a4553 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.202647 Aug 10 23:21:47.257043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 352/711] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:47 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:47.484057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:47.485436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:47.494017 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.495403 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.496088 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.497183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.497760 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.499714 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.504815 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:47.656976 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:47.670262 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:47.672042 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:47.673234 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cf6adb53-fda5-457e-95f7-acfc066496b7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1740 microversion: 2.20 time: 0.197544 Aug 10 23:21:47.687957 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 360/712] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:47 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:47.891319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-18b65940-df23-4cc5-9bbb-eb5767e00c23 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:47.892056 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-18b65940-df23-4cc5-9bbb-eb5767e00c23 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:47.900048 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18b65940-df23-4cc5-9bbb-eb5767e00c23 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.900760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18b65940-df23-4cc5-9bbb-eb5767e00c23 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.901438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18b65940-df23-4cc5-9bbb-eb5767e00c23 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.902865 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18b65940-df23-4cc5-9bbb-eb5767e00c23 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.903408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18b65940-df23-4cc5-9bbb-eb5767e00c23 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.903907 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18b65940-df23-4cc5-9bbb-eb5767e00c23 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.065109 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-18b65940-df23-4cc5-9bbb-eb5767e00c23 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:48.073427 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-18b65940-df23-4cc5-9bbb-eb5767e00c23 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1557 microversion: 2.1 time: 0.188116 Aug 10 23:21:48.075043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 353/713] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:47 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1557 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:48.097368 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-aee8cbc5-a965-4851-8a07-64be29a9f77b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:48.098169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-aee8cbc5-a965-4851-8a07-64be29a9f77b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:48.107278 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aee8cbc5-a965-4851-8a07-64be29a9f77b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.108039 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aee8cbc5-a965-4851-8a07-64be29a9f77b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.108638 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aee8cbc5-a965-4851-8a07-64be29a9f77b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.111848 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aee8cbc5-a965-4851-8a07-64be29a9f77b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.113780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aee8cbc5-a965-4851-8a07-64be29a9f77b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.115625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-aee8cbc5-a965-4851-8a07-64be29a9f77b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.222440 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-aee8cbc5-a965-4851-8a07-64be29a9f77b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129431 Aug 10 23:21:48.223370 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 361/714] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 10 23:21:48 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:48.281298 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dbd07e31-ee93-4700-9076-d33b9c2b4c8b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:48.282115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dbd07e31-ee93-4700-9076-d33b9c2b4c8b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:48.290577 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbd07e31-ee93-4700-9076-d33b9c2b4c8b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.295721 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbd07e31-ee93-4700-9076-d33b9c2b4c8b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.296384 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbd07e31-ee93-4700-9076-d33b9c2b4c8b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.297142 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbd07e31-ee93-4700-9076-d33b9c2b4c8b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.297603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbd07e31-ee93-4700-9076-d33b9c2b4c8b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.298241 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbd07e31-ee93-4700-9076-d33b9c2b4c8b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.598230 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-dbd07e31-ee93-4700-9076-d33b9c2b4c8b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:48.610493 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dbd07e31-ee93-4700-9076-d33b9c2b4c8b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.332667 Aug 10 23:21:48.617534 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 354/715] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:48 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:48.702594 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:48.703294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:48.710342 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.710847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.711478 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.712384 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.712830 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.713418 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.952667 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:48.961392 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:48.963406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:48.965509 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-66833140-7e23-4dc6-8362-f7243a4e8d42 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1740 microversion: 2.20 time: 0.267263 Aug 10 23:21:48.966269 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 362/716] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:48 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:49.546541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-217a50c2-50e5-4fcf-82e7-7258ce7443a1 req-cffbd78b-6441-4c82-a997-2e6ad37fc97e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4400e6b6-97d1-400f-9a8d-2c9db7c77042", "tag": "72395218-a18f-4a02-bea7-28b6142da97e"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:49.563455 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-217a50c2-50e5-4fcf-82e7-7258ce7443a1 req-cffbd78b-6441-4c82-a997-2e6ad37fc97e service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.563944 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-217a50c2-50e5-4fcf-82e7-7258ce7443a1 req-cffbd78b-6441-4c82-a997-2e6ad37fc97e service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.564383 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-217a50c2-50e5-4fcf-82e7-7258ce7443a1 req-cffbd78b-6441-4c82-a997-2e6ad37fc97e service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.578403 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-217a50c2-50e5-4fcf-82e7-7258ce7443a1 req-cffbd78b-6441-4c82-a997-2e6ad37fc97e service nova] Creating event network-changed:72395218-a18f-4a02-bea7-28b6142da97e for instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 on hv-cinder-85144 Aug 10 23:21:49.584581 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-217a50c2-50e5-4fcf-82e7-7258ce7443a1 req-cffbd78b-6441-4c82-a997-2e6ad37fc97e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041312 Aug 10 23:21:49.586057 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 355/717] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:49.637528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cc9132bd-0ad1-41b1-82d2-e68479cf5f93 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:49.638163 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cc9132bd-0ad1-41b1-82d2-e68479cf5f93 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:49.647418 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc9132bd-0ad1-41b1-82d2-e68479cf5f93 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.647919 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc9132bd-0ad1-41b1-82d2-e68479cf5f93 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.648361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc9132bd-0ad1-41b1-82d2-e68479cf5f93 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.649079 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc9132bd-0ad1-41b1-82d2-e68479cf5f93 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.649534 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc9132bd-0ad1-41b1-82d2-e68479cf5f93 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.649959 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cc9132bd-0ad1-41b1-82d2-e68479cf5f93 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.977587 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cc9132bd-0ad1-41b1-82d2-e68479cf5f93 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:49.988449 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cc9132bd-0ad1-41b1-82d2-e68479cf5f93 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.355605 Aug 10 23:21:49.989958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:49.991216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:49.997843 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:50.007017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:50.007017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:50.007017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:50.007017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:50.007732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:50.007894 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 363/718] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:49 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:50.261028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:50.275666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:50.280545 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:50.286471 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-63f6ec7b-cd0d-4c96-93d2-bef3adab104a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1740 microversion: 2.20 time: 0.297446 Aug 10 23:21:50.287188 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 356/719] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:49 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:21:51.012006 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-accdd64c-8675-488b-a512-efa8e48acf97 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:51.012627 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-accdd64c-8675-488b-a512-efa8e48acf97 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:51.019019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-accdd64c-8675-488b-a512-efa8e48acf97 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:51.019728 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-accdd64c-8675-488b-a512-efa8e48acf97 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:51.020166 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-accdd64c-8675-488b-a512-efa8e48acf97 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:51.020867 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-accdd64c-8675-488b-a512-efa8e48acf97 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:51.021329 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-accdd64c-8675-488b-a512-efa8e48acf97 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:51.021781 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-accdd64c-8675-488b-a512-efa8e48acf97 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:51.201034 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-accdd64c-8675-488b-a512-efa8e48acf97 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:51.212104 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-accdd64c-8675-488b-a512-efa8e48acf97 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.203839 Aug 10 23:21:51.213187 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 364/720] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:51 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:51.313861 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:51.315193 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:51.321694 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:51.322466 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:51.323133 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:51.323933 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:51.324378 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:51.324806 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:51.480354 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:51.489939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:51.491792 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:51.493396 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-61d4dfd9-53aa-45b6-828e-d141e318f3a2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1740 microversion: 2.20 time: 0.183455 Aug 10 23:21:51.493996 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 357/721] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:51 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:52.233916 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fb227d27-4b29-44da-b99c-f243f9175390 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:52.234463 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-fb227d27-4b29-44da-b99c-f243f9175390 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:52.244481 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb227d27-4b29-44da-b99c-f243f9175390 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:52.245269 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb227d27-4b29-44da-b99c-f243f9175390 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:52.245872 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb227d27-4b29-44da-b99c-f243f9175390 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:52.246812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb227d27-4b29-44da-b99c-f243f9175390 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:52.247430 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb227d27-4b29-44da-b99c-f243f9175390 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:52.248018 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fb227d27-4b29-44da-b99c-f243f9175390 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:52.414957 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-fb227d27-4b29-44da-b99c-f243f9175390 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:52.423240 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-fb227d27-4b29-44da-b99c-f243f9175390 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.193704 Aug 10 23:21:52.424429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 365/722] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:52 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:52.518070 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:52.518670 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:52.521314 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:52.526515 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:52.527054 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:52.527499 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:52.528240 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:52.528708 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:52.529144 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:52.551705 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=100 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:52.679269 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:52.688471 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:52.689770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:52.691021 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-26551d8e-7f34-4f5d-93eb-5ffc0444a885 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1740 microversion: 2.20 time: 0.177048 Aug 10 23:21:52.691597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 358/723] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:52 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:53.451063 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7f0f1895-c6a7-47bf-bb3c-48fc2d1383cb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:53.452364 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7f0f1895-c6a7-47bf-bb3c-48fc2d1383cb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:53.459632 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7f0f1895-c6a7-47bf-bb3c-48fc2d1383cb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:53.460408 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7f0f1895-c6a7-47bf-bb3c-48fc2d1383cb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:53.460841 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7f0f1895-c6a7-47bf-bb3c-48fc2d1383cb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:53.461551 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7f0f1895-c6a7-47bf-bb3c-48fc2d1383cb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:53.462026 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7f0f1895-c6a7-47bf-bb3c-48fc2d1383cb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:53.462446 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7f0f1895-c6a7-47bf-bb3c-48fc2d1383cb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:53.614677 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7f0f1895-c6a7-47bf-bb3c-48fc2d1383cb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:53.623491 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7f0f1895-c6a7-47bf-bb3c-48fc2d1383cb tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.177945 Aug 10 23:21:53.624092 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 366/724] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:53 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:53.715284 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:53.715895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:53.723023 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:53.723509 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:53.723978 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:53.724681 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:53.725139 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:53.725566 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:53.856006 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:53.864528 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:53.866131 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:53.867365 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-02bcd7b5-a6c5-48d9-8f8b-c24987e6e6af tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1740 microversion: 2.20 time: 0.156351 Aug 10 23:21:53.871230 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 359/725] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:53 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:54.644687 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-32889668-fcba-4f30-bde7-c9128fd8ce23 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:54.645281 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-32889668-fcba-4f30-bde7-c9128fd8ce23 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:54.652019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-32889668-fcba-4f30-bde7-c9128fd8ce23 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:54.652606 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-32889668-fcba-4f30-bde7-c9128fd8ce23 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:54.653066 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-32889668-fcba-4f30-bde7-c9128fd8ce23 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:54.653817 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-32889668-fcba-4f30-bde7-c9128fd8ce23 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:54.654265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-32889668-fcba-4f30-bde7-c9128fd8ce23 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:54.654736 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-32889668-fcba-4f30-bde7-c9128fd8ce23 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:54.789453 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-32889668-fcba-4f30-bde7-c9128fd8ce23 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:54.797621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-32889668-fcba-4f30-bde7-c9128fd8ce23 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.156844 Aug 10 23:21:54.798188 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 367/726] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:54 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:54.892143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:54.892753 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:54.899144 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:54.899619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:54.900049 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:54.900742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:54.901191 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:54.902146 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:55.129488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:55.138219 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:55.139816 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:55.140992 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5f8d6cbf-cd69-4610-a8b2-46191407a4ca tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1722 microversion: 2.20 time: 0.252823 Aug 10 23:21:55.141557 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 360/727] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:54 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:55.818350 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6113b183-f861-4258-95f1-9bcbcde1c738 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:55.819065 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6113b183-f861-4258-95f1-9bcbcde1c738 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:55.825454 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6113b183-f861-4258-95f1-9bcbcde1c738 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:55.825928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6113b183-f861-4258-95f1-9bcbcde1c738 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:55.826358 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6113b183-f861-4258-95f1-9bcbcde1c738 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:55.827074 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6113b183-f861-4258-95f1-9bcbcde1c738 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:55.827522 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6113b183-f861-4258-95f1-9bcbcde1c738 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:55.827942 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6113b183-f861-4258-95f1-9bcbcde1c738 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:55.960153 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6113b183-f861-4258-95f1-9bcbcde1c738 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:55.968202 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6113b183-f861-4258-95f1-9bcbcde1c738 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.153655 Aug 10 23:21:55.968768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 368/728] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:55 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:56.164890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:56.165558 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:56.172449 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:56.172920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:56.173350 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:56.174037 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:56.174532 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:56.175004 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:56.305710 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:56.313597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:56.315142 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:56.316293 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-49628708-8aa1-4d9b-9ed3-047fe4006350 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1722 microversion: 2.20 time: 0.155415 Aug 10 23:21:56.316857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 361/729] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:56 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:56.989445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f96b3acc-1ada-4fcb-b795-9be7ef20859c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:56.990050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f96b3acc-1ada-4fcb-b795-9be7ef20859c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:56.997159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f96b3acc-1ada-4fcb-b795-9be7ef20859c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:56.997639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f96b3acc-1ada-4fcb-b795-9be7ef20859c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:56.998075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f96b3acc-1ada-4fcb-b795-9be7ef20859c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:56.998794 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f96b3acc-1ada-4fcb-b795-9be7ef20859c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:56.999246 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f96b3acc-1ada-4fcb-b795-9be7ef20859c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:56.999671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f96b3acc-1ada-4fcb-b795-9be7ef20859c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.134192 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f96b3acc-1ada-4fcb-b795-9be7ef20859c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:57.142617 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f96b3acc-1ada-4fcb-b795-9be7ef20859c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.157076 Aug 10 23:21:57.144639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 369/730] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:56 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:57.339537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:57.340075 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:57.346474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.347003 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.347522 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.348169 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.348608 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.349033 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.774925 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:57.783305 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:57.784816 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:57.785968 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ce11998b-36be-4abf-8093-001e520a506f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1722 microversion: 2.20 time: 0.450714 Aug 10 23:21:57.786533 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 362/731] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:57 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1722 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:58.164910 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6529b1c5-75ec-4134-a050-a5269550785a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:58.165663 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6529b1c5-75ec-4134-a050-a5269550785a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:58.171785 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6529b1c5-75ec-4134-a050-a5269550785a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.173159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6529b1c5-75ec-4134-a050-a5269550785a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.173159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6529b1c5-75ec-4134-a050-a5269550785a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:58.173435 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6529b1c5-75ec-4134-a050-a5269550785a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.173898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6529b1c5-75ec-4134-a050-a5269550785a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.174334 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6529b1c5-75ec-4134-a050-a5269550785a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:58.356000 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6529b1c5-75ec-4134-a050-a5269550785a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:58.363419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6529b1c5-75ec-4134-a050-a5269550785a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.202386 Aug 10 23:21:58.363981 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 370/732] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:58 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:58.809553 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:58.810175 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:58.816631 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.817122 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.817560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:58.818278 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.818754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.819182 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:58.891826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-db52e5c6-5fe4-42e2-8d5d-bcd4850243cb req-a9081be9-831f-4784-863d-97d82e830785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40168342-ce20-4df4-9112-60c03c657239", "name": "network-vif-unplugged", "status": "completed", "tag": "33300b87-970b-4a82-b42e-51c6998b535a"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:58.908062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-db52e5c6-5fe4-42e2-8d5d-bcd4850243cb req-a9081be9-831f-4784-863d-97d82e830785 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.908062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-db52e5c6-5fe4-42e2-8d5d-bcd4850243cb req-a9081be9-831f-4784-863d-97d82e830785 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.908062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-db52e5c6-5fe4-42e2-8d5d-bcd4850243cb req-a9081be9-831f-4784-863d-97d82e830785 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:58.913797 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.compute.server_external_events [req-db52e5c6-5fe4-42e2-8d5d-bcd4850243cb req-a9081be9-831f-4784-863d-97d82e830785 service nova] Unable to find a host for instance 40168342-ce20-4df4-9112-60c03c657239. Dropping event network-vif-unplugged {{(pid=121332) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 23:21:58.914760 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-db52e5c6-5fe4-42e2-8d5d-bcd4850243cb req-a9081be9-831f-4784-863d-97d82e830785 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026792 Aug 10 23:21:58.915517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 371/733] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 10 23:21:58.956198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:58.965144 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:58.968403 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:58.968403 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-586545f2-ebd5-4d98-b547-0874e0c53514 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1665 microversion: 2.20 time: 0.162285 Aug 10 23:21:58.968751 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 363/734] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:21:58 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:21:58.991251 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ef234bab-3e33-40f3-b726-f9afa4cf09e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ddb472f-e27f-4e43-81ed-7898148d348b"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:58.993874 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ef234bab-3e33-40f3-b726-f9afa4cf09e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:59.000026 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef234bab-3e33-40f3-b726-f9afa4cf09e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:59.000568 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef234bab-3e33-40f3-b726-f9afa4cf09e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:59.001005 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef234bab-3e33-40f3-b726-f9afa4cf09e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:59.001711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef234bab-3e33-40f3-b726-f9afa4cf09e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:59.002167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef234bab-3e33-40f3-b726-f9afa4cf09e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:59.002592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef234bab-3e33-40f3-b726-f9afa4cf09e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:59.383301 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b58e94da-0708-4c0e-abb8-1d9a48da20f2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:59.388522 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b58e94da-0708-4c0e-abb8-1d9a48da20f2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:59.390357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b58e94da-0708-4c0e-abb8-1d9a48da20f2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:59.390894 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b58e94da-0708-4c0e-abb8-1d9a48da20f2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:59.391343 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b58e94da-0708-4c0e-abb8-1d9a48da20f2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:59.392048 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b58e94da-0708-4c0e-abb8-1d9a48da20f2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:59.392953 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b58e94da-0708-4c0e-abb8-1d9a48da20f2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:59.393387 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b58e94da-0708-4c0e-abb8-1d9a48da20f2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:59.528643 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b58e94da-0708-4c0e-abb8-1d9a48da20f2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:59.536152 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b58e94da-0708-4c0e-abb8-1d9a48da20f2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.156786 Aug 10 23:21:59.537494 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 364/735] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:59 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:00.027423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-21507142-e5e3-4b12-adea-6ae2ce9f7826 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:00.028089 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-21507142-e5e3-4b12-adea-6ae2ce9f7826 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:00.034334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21507142-e5e3-4b12-adea-6ae2ce9f7826 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.034927 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21507142-e5e3-4b12-adea-6ae2ce9f7826 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.035367 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21507142-e5e3-4b12-adea-6ae2ce9f7826 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.036064 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21507142-e5e3-4b12-adea-6ae2ce9f7826 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.036573 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21507142-e5e3-4b12-adea-6ae2ce9f7826 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.036948 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-21507142-e5e3-4b12-adea-6ae2ce9f7826 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.069604 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-21507142-e5e3-4b12-adea-6ae2ce9f7826 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/ips" status: 200 len: 145 microversion: 2.1 time: 0.046517 Aug 10 23:22:00.070204 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 365/736] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 10 23:22:00 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:22:00.156912 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ef234bab-3e33-40f3-b726-f9afa4cf09e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "POST /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.169828 Aug 10 23:22:00.157744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 372/737] 10.222.0.78 () {62 vars in 1364 bytes} [Wed Aug 10 23:21:58 2022] POST /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/os-volume_attachments => generated 188 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:22:00.297258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6718d199-07d5-4b50-9d33-bf2a9f87bbee tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:00.297692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6718d199-07d5-4b50-9d33-bf2a9f87bbee tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:00.303684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6718d199-07d5-4b50-9d33-bf2a9f87bbee tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.304165 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6718d199-07d5-4b50-9d33-bf2a9f87bbee tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.304602 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6718d199-07d5-4b50-9d33-bf2a9f87bbee tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.305296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6718d199-07d5-4b50-9d33-bf2a9f87bbee tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.305782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6718d199-07d5-4b50-9d33-bf2a9f87bbee tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.306233 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6718d199-07d5-4b50-9d33-bf2a9f87bbee tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.557735 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f331a97d-4e86-4174-aa15-0710dca736b3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:00.558347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f331a97d-4e86-4174-aa15-0710dca736b3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:00.567407 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f331a97d-4e86-4174-aa15-0710dca736b3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.567899 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f331a97d-4e86-4174-aa15-0710dca736b3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.568334 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f331a97d-4e86-4174-aa15-0710dca736b3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.569042 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f331a97d-4e86-4174-aa15-0710dca736b3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.569622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f331a97d-4e86-4174-aa15-0710dca736b3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.569900 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f331a97d-4e86-4174-aa15-0710dca736b3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.710574 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f331a97d-4e86-4174-aa15-0710dca736b3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:00.719988 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f331a97d-4e86-4174-aa15-0710dca736b3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.166514 Aug 10 23:22:00.720873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 373/738] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:00 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:00.865898 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6718d199-07d5-4b50-9d33-bf2a9f87bbee tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "DELETE /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/os-volume_attachments/6ddb472f-e27f-4e43-81ed-7898148d348b" status: 202 len: 0 microversion: 2.20 time: 0.572561 Aug 10 23:22:00.866428 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 366/739] 10.222.0.78 () {60 vars in 1457 bytes} [Wed Aug 10 23:22:00 2022] DELETE /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/os-volume_attachments/6ddb472f-e27f-4e43-81ed-7898148d348b => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:22:00.926550 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0959878f-1dbe-4163-83aa-e419d73f259f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:00.927180 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0959878f-1dbe-4163-83aa-e419d73f259f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:00.933701 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0959878f-1dbe-4163-83aa-e419d73f259f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.934177 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0959878f-1dbe-4163-83aa-e419d73f259f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.934604 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0959878f-1dbe-4163-83aa-e419d73f259f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.937151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0959878f-1dbe-4163-83aa-e419d73f259f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.937151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0959878f-1dbe-4163-83aa-e419d73f259f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.937151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0959878f-1dbe-4163-83aa-e419d73f259f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.965288 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0959878f-1dbe-4163-83aa-e419d73f259f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121332) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 10 23:22:01.079954 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:01.297131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0959878f-1dbe-4163-83aa-e419d73f259f tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "POST /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/action" status: 202 len: 0 microversion: 2.20 time: 0.374468 Aug 10 23:22:01.297827 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 374/740] 10.222.0.78 () {62 vars in 1319 bytes} [Wed Aug 10 23:22:00 2022] POST /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:22:01.305982 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:01.306597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:01.313876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.314361 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.314931 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:01.315638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.316094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.316520 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:01.450576 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:01.459157 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:01.460696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:01.461854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b0937da4-1873-49c5-af29-9fd291255794 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1673 microversion: 2.20 time: 0.159890 Aug 10 23:22:01.462421 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 367/741] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:01 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:01.742192 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-52c27ecb-d168-4b75-be6e-3ef891acc2d5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:01.743092 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-52c27ecb-d168-4b75-be6e-3ef891acc2d5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:01.749901 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52c27ecb-d168-4b75-be6e-3ef891acc2d5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.750391 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52c27ecb-d168-4b75-be6e-3ef891acc2d5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.750866 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52c27ecb-d168-4b75-be6e-3ef891acc2d5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:01.751573 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52c27ecb-d168-4b75-be6e-3ef891acc2d5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.752026 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52c27ecb-d168-4b75-be6e-3ef891acc2d5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.752447 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52c27ecb-d168-4b75-be6e-3ef891acc2d5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:01.915787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-52c27ecb-d168-4b75-be6e-3ef891acc2d5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:01.924556 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-52c27ecb-d168-4b75-be6e-3ef891acc2d5 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1508 microversion: 2.1 time: 0.187253 Aug 10 23:22:01.925134 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 375/742] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:01 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:01.947243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c328210d-cfd3-4e27-8683-51fd9b211307 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:01.947881 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c328210d-cfd3-4e27-8683-51fd9b211307 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:01.955042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c328210d-cfd3-4e27-8683-51fd9b211307 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.955535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c328210d-cfd3-4e27-8683-51fd9b211307 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.956021 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c328210d-cfd3-4e27-8683-51fd9b211307 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:01.956985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c328210d-cfd3-4e27-8683-51fd9b211307 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.957451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c328210d-cfd3-4e27-8683-51fd9b211307 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.957881 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c328210d-cfd3-4e27-8683-51fd9b211307 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:02.006074 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c328210d-cfd3-4e27-8683-51fd9b211307 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121333) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 10 23:22:02.365859 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c328210d-cfd3-4e27-8683-51fd9b211307 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "POST /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79/action" status: 202 len: 0 microversion: 2.1 time: 0.424603 Aug 10 23:22:02.367256 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 368/743] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:22:01 2022] POST /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:22:02.377163 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-44883e4d-8e05-41fb-938c-48ee5c20a8ed tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:02.377833 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-44883e4d-8e05-41fb-938c-48ee5c20a8ed tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:02.388424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44883e4d-8e05-41fb-938c-48ee5c20a8ed tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:02.388935 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44883e4d-8e05-41fb-938c-48ee5c20a8ed tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:02.389351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44883e4d-8e05-41fb-938c-48ee5c20a8ed tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:02.394769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44883e4d-8e05-41fb-938c-48ee5c20a8ed tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:02.394769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44883e4d-8e05-41fb-938c-48ee5c20a8ed tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:02.394769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44883e4d-8e05-41fb-938c-48ee5c20a8ed tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:02.486062 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:02.486743 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:02.493983 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:02.496042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:02.496042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:02.496042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:02.496042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:02.496583 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:02.558815 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-44883e4d-8e05-41fb-938c-48ee5c20a8ed tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:02.570507 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-44883e4d-8e05-41fb-938c-48ee5c20a8ed tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1516 microversion: 2.1 time: 0.197929 Aug 10 23:22:02.570906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 376/744] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:02 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:02.652187 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:02.667814 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:02.667814 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:02.667814 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-83548ef8-0a15-481d-9237-29c1aecbf42c tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1673 microversion: 2.20 time: 0.180817 Aug 10 23:22:02.668148 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 369/745] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:02 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:02.918804 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-f80768ad-1d3b-4788-a1d0-42f435ce0000 req-de00ff2f-b536-416d-a1fb-5c1c0a042576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace5e95d-7b24-4111-ae18-7185b8662c79", "name": "network-vif-unplugged", "status": "completed", "tag": "cd7e7501-d9b2-4b2f-9318-8204c144c269"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:02.933864 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-f80768ad-1d3b-4788-a1d0-42f435ce0000 req-de00ff2f-b536-416d-a1fb-5c1c0a042576 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:02.934348 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-f80768ad-1d3b-4788-a1d0-42f435ce0000 req-de00ff2f-b536-416d-a1fb-5c1c0a042576 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:02.934811 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-f80768ad-1d3b-4788-a1d0-42f435ce0000 req-de00ff2f-b536-416d-a1fb-5c1c0a042576 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:02.951354 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.compute.server_external_events [req-f80768ad-1d3b-4788-a1d0-42f435ce0000 req-de00ff2f-b536-416d-a1fb-5c1c0a042576 service nova] Unable to find a host for instance ace5e95d-7b24-4111-ae18-7185b8662c79. Dropping event network-vif-unplugged {{(pid=121332) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 23:22:02.953465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-f80768ad-1d3b-4788-a1d0-42f435ce0000 req-de00ff2f-b536-416d-a1fb-5c1c0a042576 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045699 Aug 10 23:22:02.953465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 377/746] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 23:22:03.591575 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e846ce6e-9a2c-4536-ab7e-663fa63e3a89 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:03.592123 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e846ce6e-9a2c-4536-ab7e-663fa63e3a89 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:03.598527 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e846ce6e-9a2c-4536-ab7e-663fa63e3a89 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:03.599076 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e846ce6e-9a2c-4536-ab7e-663fa63e3a89 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:03.599516 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e846ce6e-9a2c-4536-ab7e-663fa63e3a89 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:03.600231 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e846ce6e-9a2c-4536-ab7e-663fa63e3a89 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:03.600779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e846ce6e-9a2c-4536-ab7e-663fa63e3a89 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:03.601127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e846ce6e-9a2c-4536-ab7e-663fa63e3a89 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:03.686105 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:03.686710 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:03.692807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:03.693445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:03.693878 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:03.694566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:03.695043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:03.695463 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:03.893465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e846ce6e-9a2c-4536-ab7e-663fa63e3a89 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:03.902167 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e846ce6e-9a2c-4536-ab7e-663fa63e3a89 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1516 microversion: 2.1 time: 0.314715 Aug 10 23:22:03.903114 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 370/747] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:03 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:03.913640 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8e5c48f4-3670-4ce2-9b9c-4934e0f22bef tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f04bfdc5-2051-4398-a3c6-a4b0157146fc"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:03.916408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8e5c48f4-3670-4ce2-9b9c-4934e0f22bef tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:03.923086 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e5c48f4-3670-4ce2-9b9c-4934e0f22bef tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:03.923579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e5c48f4-3670-4ce2-9b9c-4934e0f22bef tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:03.924129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e5c48f4-3670-4ce2-9b9c-4934e0f22bef tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:03.924870 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e5c48f4-3670-4ce2-9b9c-4934e0f22bef tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:03.925329 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e5c48f4-3670-4ce2-9b9c-4934e0f22bef tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:03.925821 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8e5c48f4-3670-4ce2-9b9c-4934e0f22bef tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:03.950020 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:03.959086 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:03.961021 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:03.962351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-82b40f7a-9c15-4807-b361-1bcdebb646f2 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.280224 Aug 10 23:22:03.990317 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 378/748] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:03 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:04.153241 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:04.924422 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d48aa0d8-8ba5-4679-a6f3-f91be273cf49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:04.925042 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d48aa0d8-8ba5-4679-a6f3-f91be273cf49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:04.931978 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d48aa0d8-8ba5-4679-a6f3-f91be273cf49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:04.933059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d48aa0d8-8ba5-4679-a6f3-f91be273cf49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:04.933686 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d48aa0d8-8ba5-4679-a6f3-f91be273cf49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:04.934401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d48aa0d8-8ba5-4679-a6f3-f91be273cf49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:04.935087 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d48aa0d8-8ba5-4679-a6f3-f91be273cf49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:04.935746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d48aa0d8-8ba5-4679-a6f3-f91be273cf49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:04.999271 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8e5c48f4-3670-4ce2-9b9c-4934e0f22bef tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.093340 Aug 10 23:22:04.999966 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 371/749] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:22:03 2022] POST /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/os-volume_attachments => generated 194 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:22:05.014867 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:05.014867 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:05.021850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:05.025974 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:05.026495 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:05.027285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:05.027759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:05.028194 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:05.115516 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d48aa0d8-8ba5-4679-a6f3-f91be273cf49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:05.125362 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d48aa0d8-8ba5-4679-a6f3-f91be273cf49 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.204860 Aug 10 23:22:05.125945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 379/750] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:04 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:05.220107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:05.236114 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:05.237632 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:05.238851 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-94d66bdc-bf9e-438a-8643-14e94ae13751 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.237544 Aug 10 23:22:05.239420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 372/751] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:05 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:06.145962 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6d3f6cbc-ec8c-4f7f-8440-571286ea0da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:06.146581 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6d3f6cbc-ec8c-4f7f-8440-571286ea0da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:06.153110 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d3f6cbc-ec8c-4f7f-8440-571286ea0da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:06.153598 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d3f6cbc-ec8c-4f7f-8440-571286ea0da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:06.154039 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d3f6cbc-ec8c-4f7f-8440-571286ea0da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:06.154764 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d3f6cbc-ec8c-4f7f-8440-571286ea0da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:06.155226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d3f6cbc-ec8c-4f7f-8440-571286ea0da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:06.155654 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d3f6cbc-ec8c-4f7f-8440-571286ea0da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:06.262880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:06.263508 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:06.269628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:06.270104 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:06.270536 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:06.271259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:06.271706 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:06.272130 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:06.284209 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6d3f6cbc-ec8c-4f7f-8440-571286ea0da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:06.292389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6d3f6cbc-ec8c-4f7f-8440-571286ea0da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.149722 Aug 10 23:22:06.292963 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 380/752] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:06 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:06.417681 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:06.428124 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:06.429955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:06.431182 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-39db8c0d-4ac3-47a6-a230-7e7d96c27c8d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.172876 Aug 10 23:22:06.432108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 373/753] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:06 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:07.319258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-62f69978-65d0-479e-abd0-58dda8829d88 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:07.319901 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-62f69978-65d0-479e-abd0-58dda8829d88 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:07.326867 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-62f69978-65d0-479e-abd0-58dda8829d88 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:07.327351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-62f69978-65d0-479e-abd0-58dda8829d88 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:07.327923 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-62f69978-65d0-479e-abd0-58dda8829d88 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:07.328627 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-62f69978-65d0-479e-abd0-58dda8829d88 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:07.329087 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-62f69978-65d0-479e-abd0-58dda8829d88 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:07.329684 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-62f69978-65d0-479e-abd0-58dda8829d88 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:07.456392 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:07.458283 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:07.474472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:07.475274 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:07.475765 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:07.484899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:07.484899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:07.484899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:07.485320 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-62f69978-65d0-479e-abd0-58dda8829d88 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:07.487320 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-62f69978-65d0-479e-abd0-58dda8829d88 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.171941 Aug 10 23:22:07.488017 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 381/754] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:07 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:07.626832 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:07.635154 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:07.637454 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:07.638716 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-306a9c60-10dc-4450-b895-a7fff427cfa9 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.187370 Aug 10 23:22:07.639351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 374/755] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:07 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:08.509111 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4ab9ba27-946a-41cd-aa3c-6952df69342e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:08.509712 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4ab9ba27-946a-41cd-aa3c-6952df69342e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:08.516895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4ab9ba27-946a-41cd-aa3c-6952df69342e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:08.517374 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4ab9ba27-946a-41cd-aa3c-6952df69342e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:08.517815 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4ab9ba27-946a-41cd-aa3c-6952df69342e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:08.518516 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4ab9ba27-946a-41cd-aa3c-6952df69342e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:08.519000 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4ab9ba27-946a-41cd-aa3c-6952df69342e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:08.519431 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4ab9ba27-946a-41cd-aa3c-6952df69342e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:08.654502 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-4ab9ba27-946a-41cd-aa3c-6952df69342e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:08.661816 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:08.662351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4ab9ba27-946a-41cd-aa3c-6952df69342e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.157061 Aug 10 23:22:08.662567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:08.662830 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 382/756] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:08 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:08.670759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:08.670759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:08.670759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:08.671568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:08.672028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:08.672666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:08.822020 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:08.831016 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:08.832558 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:08.833717 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b653acb1-fccb-4e2d-a455-a32ebb28dc1d tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.175966 Aug 10 23:22:08.834286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 375/757] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:08 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:09.690296 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-65872d3b-17c2-49cc-8ce7-9b55e15c370e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:09.692398 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-65872d3b-17c2-49cc-8ce7-9b55e15c370e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:09.702917 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65872d3b-17c2-49cc-8ce7-9b55e15c370e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:09.703952 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65872d3b-17c2-49cc-8ce7-9b55e15c370e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:09.704688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65872d3b-17c2-49cc-8ce7-9b55e15c370e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:09.705801 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65872d3b-17c2-49cc-8ce7-9b55e15c370e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:09.706633 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65872d3b-17c2-49cc-8ce7-9b55e15c370e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:09.707393 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-65872d3b-17c2-49cc-8ce7-9b55e15c370e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:09.844653 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-65872d3b-17c2-49cc-8ce7-9b55e15c370e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:09.856393 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:09.857615 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:09.864139 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-65872d3b-17c2-49cc-8ce7-9b55e15c370e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.178814 Aug 10 23:22:09.866549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:09.867723 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 383/758] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:09 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:09.868534 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:09.868979 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:09.870247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:09.870728 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:09.871294 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:10.003204 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:10.011773 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:10.013281 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:10.014455 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-896f0c4d-494a-4328-8b22-ed3b8c6bd615 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.161998 Aug 10 23:22:10.015281 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 376/759] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:09 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:10.889279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-44c11c8b-20be-45fb-88ba-d2e9c3acf7e9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:10.891068 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-44c11c8b-20be-45fb-88ba-d2e9c3acf7e9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:10.898312 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44c11c8b-20be-45fb-88ba-d2e9c3acf7e9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:10.899198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44c11c8b-20be-45fb-88ba-d2e9c3acf7e9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:10.899946 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44c11c8b-20be-45fb-88ba-d2e9c3acf7e9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:10.901647 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44c11c8b-20be-45fb-88ba-d2e9c3acf7e9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:10.902183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44c11c8b-20be-45fb-88ba-d2e9c3acf7e9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:10.902706 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44c11c8b-20be-45fb-88ba-d2e9c3acf7e9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:11.037381 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:11.038026 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:11.044609 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:11.044770 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-44c11c8b-20be-45fb-88ba-d2e9c3acf7e9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:11.045106 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:11.045541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:11.046251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:11.046734 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:11.047168 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:11.052514 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-44c11c8b-20be-45fb-88ba-d2e9c3acf7e9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.167889 Aug 10 23:22:11.053087 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 384/760] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:10 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:11.205018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:11.216679 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:11.218504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:11.219864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-38e0374d-442a-48c4-82aa-adbb9a325048 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.186357 Aug 10 23:22:11.220540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 377/761] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:11 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:12.075753 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fa2eb947-ea10-4089-9b0f-ad383c6e17db tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:12.077206 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-fa2eb947-ea10-4089-9b0f-ad383c6e17db tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:12.084108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fa2eb947-ea10-4089-9b0f-ad383c6e17db tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:12.085087 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fa2eb947-ea10-4089-9b0f-ad383c6e17db tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:12.085611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fa2eb947-ea10-4089-9b0f-ad383c6e17db tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:12.086407 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fa2eb947-ea10-4089-9b0f-ad383c6e17db tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:12.087129 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fa2eb947-ea10-4089-9b0f-ad383c6e17db tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:12.087633 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fa2eb947-ea10-4089-9b0f-ad383c6e17db tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:12.243762 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:12.244362 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:12.251038 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:12.251881 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:12.252572 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:12.253330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:12.253991 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:12.254418 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:12.262371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-fa2eb947-ea10-4089-9b0f-ad383c6e17db tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:12.270603 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-fa2eb947-ea10-4089-9b0f-ad383c6e17db tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.201063 Aug 10 23:22:12.271622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 385/762] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:12 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:12.548955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:12.548955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:12.551103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:12.551103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-38b776fb-b77d-4709-bb86-d8286a4579e0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.199081 Aug 10 23:22:12.551103 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 378/763] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:12 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:13.293722 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3441ae57-f37b-47f3-9de3-14276c8c835b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:13.294363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3441ae57-f37b-47f3-9de3-14276c8c835b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:13.301247 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3441ae57-f37b-47f3-9de3-14276c8c835b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:13.301736 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3441ae57-f37b-47f3-9de3-14276c8c835b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:13.302183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3441ae57-f37b-47f3-9de3-14276c8c835b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:13.303059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3441ae57-f37b-47f3-9de3-14276c8c835b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:13.304040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3441ae57-f37b-47f3-9de3-14276c8c835b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:13.304476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3441ae57-f37b-47f3-9de3-14276c8c835b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:13.462008 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3441ae57-f37b-47f3-9de3-14276c8c835b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:13.472518 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3441ae57-f37b-47f3-9de3-14276c8c835b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.182631 Aug 10 23:22:13.480402 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 386/764] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:13 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:13.675742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:13.675742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:13.675742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:13.675742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:13.676588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:13.676588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:13.676588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:13.676588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:13.825866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:13.834121 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:13.835647 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:13.836798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-abfb7bf2-a0d6-442e-915f-80c4ec830452 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.192894 Aug 10 23:22:13.837359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 379/765] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:13 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:14.493294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e19d8bee-1269-4df4-8646-0e6ca912588f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:14.495283 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e19d8bee-1269-4df4-8646-0e6ca912588f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:14.496532 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:14.501256 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19d8bee-1269-4df4-8646-0e6ca912588f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:14.501768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19d8bee-1269-4df4-8646-0e6ca912588f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:14.502205 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19d8bee-1269-4df4-8646-0e6ca912588f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:14.502932 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19d8bee-1269-4df4-8646-0e6ca912588f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:14.503388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19d8bee-1269-4df4-8646-0e6ca912588f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:14.503812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19d8bee-1269-4df4-8646-0e6ca912588f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:14.646280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e19d8bee-1269-4df4-8646-0e6ca912588f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:14.656580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e19d8bee-1269-4df4-8646-0e6ca912588f tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.166964 Aug 10 23:22:14.657711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 387/766] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:14 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:14.859857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:14.860550 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:14.867556 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:14.868057 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:14.868501 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:14.869264 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:14.869690 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:14.870146 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:15.026008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:15.034516 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:15.035675 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:15.036811 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7d90e069-11b5-427b-b862-bd00b01b23d7 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.180964 Aug 10 23:22:15.037364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 380/767] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:14 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:15.677913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3e1d7918-fc2a-4c9f-8a26-2ab6e74f47ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:15.678555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3e1d7918-fc2a-4c9f-8a26-2ab6e74f47ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:15.686828 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3e1d7918-fc2a-4c9f-8a26-2ab6e74f47ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:15.687306 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3e1d7918-fc2a-4c9f-8a26-2ab6e74f47ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:15.687739 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3e1d7918-fc2a-4c9f-8a26-2ab6e74f47ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:15.688437 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3e1d7918-fc2a-4c9f-8a26-2ab6e74f47ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:15.688889 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3e1d7918-fc2a-4c9f-8a26-2ab6e74f47ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:15.689312 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3e1d7918-fc2a-4c9f-8a26-2ab6e74f47ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:15.823925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3e1d7918-fc2a-4c9f-8a26-2ab6e74f47ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:15.831334 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3e1d7918-fc2a-4c9f-8a26-2ab6e74f47ac tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.157768 Aug 10 23:22:15.831897 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 388/768] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:15 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:16.059492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:16.060108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:16.066493 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:16.067077 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:16.067516 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:16.068214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:16.068667 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:16.069094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:16.195440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:16.203835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:16.205337 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:16.206491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d64820db-e4ec-4bbb-8a6b-c5910cf98a3e tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.150916 Aug 10 23:22:16.207087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 381/769] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:16 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:16.860491 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-34626192-5ba6-4769-886f-f516dc186c1c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:16.861112 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-34626192-5ba6-4769-886f-f516dc186c1c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:16.867529 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-34626192-5ba6-4769-886f-f516dc186c1c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:16.868013 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-34626192-5ba6-4769-886f-f516dc186c1c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:16.868552 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-34626192-5ba6-4769-886f-f516dc186c1c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:16.869238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-34626192-5ba6-4769-886f-f516dc186c1c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:16.869689 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-34626192-5ba6-4769-886f-f516dc186c1c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:16.870111 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-34626192-5ba6-4769-886f-f516dc186c1c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:17.002502 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-34626192-5ba6-4769-886f-f516dc186c1c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:17.009824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-34626192-5ba6-4769-886f-f516dc186c1c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.153909 Aug 10 23:22:17.010383 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 389/770] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:16 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:17.239771 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:17.240399 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:17.246939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:17.247404 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:17.247835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:17.248534 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:17.248993 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:17.249419 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:17.376440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:17.384802 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:17.386316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:17.387516 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5141facd-f5bf-4e2a-ad88-94fdf3e74afa tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.151733 Aug 10 23:22:17.388071 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 382/771] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:17 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:18.029768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-01c0d351-f0da-4a02-ae27-10fc39173e45 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:18.030380 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-01c0d351-f0da-4a02-ae27-10fc39173e45 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:18.036732 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01c0d351-f0da-4a02-ae27-10fc39173e45 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:18.037210 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01c0d351-f0da-4a02-ae27-10fc39173e45 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:18.037642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01c0d351-f0da-4a02-ae27-10fc39173e45 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:18.038329 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01c0d351-f0da-4a02-ae27-10fc39173e45 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:18.038806 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01c0d351-f0da-4a02-ae27-10fc39173e45 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:18.039233 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01c0d351-f0da-4a02-ae27-10fc39173e45 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:18.166483 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-01c0d351-f0da-4a02-ae27-10fc39173e45 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:18.174038 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-01c0d351-f0da-4a02-ae27-10fc39173e45 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.148179 Aug 10 23:22:18.174608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 390/772] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:18 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:18.409877 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:18.410481 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:18.417095 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:18.417568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:18.417998 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:18.419217 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:18.419667 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:18.420089 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:18.555380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:18.563917 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:18.565426 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:18.566584 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-11125571-2542-42b9-86ee-8ce06bc0db62 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.160537 Aug 10 23:22:18.567179 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 383/773] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:18 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:19.195265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3f50c6e0-9c93-4a2b-939c-cc54c0a6fc85 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:19.195790 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3f50c6e0-9c93-4a2b-939c-cc54c0a6fc85 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:19.202671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f50c6e0-9c93-4a2b-939c-cc54c0a6fc85 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:19.203160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f50c6e0-9c93-4a2b-939c-cc54c0a6fc85 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:19.203596 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f50c6e0-9c93-4a2b-939c-cc54c0a6fc85 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:19.204280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f50c6e0-9c93-4a2b-939c-cc54c0a6fc85 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:19.204731 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f50c6e0-9c93-4a2b-939c-cc54c0a6fc85 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:19.205151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f50c6e0-9c93-4a2b-939c-cc54c0a6fc85 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:19.223265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:19.334274 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3f50c6e0-9c93-4a2b-939c-cc54c0a6fc85 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:19.343008 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3f50c6e0-9c93-4a2b-939c-cc54c0a6fc85 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.151615 Aug 10 23:22:19.343587 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 391/774] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:19 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:19.588869 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:19.589416 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:19.595783 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:19.596264 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:19.596701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:19.597400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:19.597858 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:19.598287 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:19.726478 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:19.734899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:19.736411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:19.737562 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-849b46d7-a8e3-4275-b5ea-28266fb60cab tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.152922 Aug 10 23:22:19.738130 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 384/775] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:19 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:20.364044 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a40343fd-f398-47bd-af9f-20450309d406 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:20.364590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a40343fd-f398-47bd-af9f-20450309d406 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:20.370945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40343fd-f398-47bd-af9f-20450309d406 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:20.371429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40343fd-f398-47bd-af9f-20450309d406 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:20.371894 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40343fd-f398-47bd-af9f-20450309d406 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:20.372584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40343fd-f398-47bd-af9f-20450309d406 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:20.373036 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40343fd-f398-47bd-af9f-20450309d406 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:20.373459 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a40343fd-f398-47bd-af9f-20450309d406 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:20.503371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a40343fd-f398-47bd-af9f-20450309d406 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:20.510920 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a40343fd-f398-47bd-af9f-20450309d406 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1518 microversion: 2.1 time: 0.150702 Aug 10 23:22:20.511482 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 392/776] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:20 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:20.760976 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:20.761598 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:20.769012 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:20.769499 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:20.769937 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:20.770637 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:20.771114 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:20.771647 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:20.905253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:20.913684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:20.922195 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:20.922195 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c1a1d8f4-dada-4a66-b7e7-b02d69e5420b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.159446 Aug 10 23:22:20.922195 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 385/777] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:20 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:21.533330 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5b44b958-9eae-412d-b035-cddd9b6301aa tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:21.533949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5b44b958-9eae-412d-b035-cddd9b6301aa tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:21.540984 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b44b958-9eae-412d-b035-cddd9b6301aa tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:21.541470 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b44b958-9eae-412d-b035-cddd9b6301aa tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:21.541910 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b44b958-9eae-412d-b035-cddd9b6301aa tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:21.542611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b44b958-9eae-412d-b035-cddd9b6301aa tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:21.543658 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b44b958-9eae-412d-b035-cddd9b6301aa tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:21.544112 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5b44b958-9eae-412d-b035-cddd9b6301aa tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:21.752447 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5b44b958-9eae-412d-b035-cddd9b6301aa tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:21.760093 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5b44b958-9eae-412d-b035-cddd9b6301aa tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.230657 Aug 10 23:22:21.760672 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 393/778] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:21 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:21.939549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:21.940153 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:21.946591 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:21.951875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:21.951875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:21.951875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:21.951875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:21.952265 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.083980 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:22.093047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:22.094590 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:22.095804 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0a7e875a-3d54-4905-8a53-d6b57de20924 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.160153 Aug 10 23:22:22.096373 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 386/779] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:21 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:22.780693 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5f2ad557-da14-445e-9d56-5b108182ae1e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.781236 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5f2ad557-da14-445e-9d56-5b108182ae1e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.787686 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f2ad557-da14-445e-9d56-5b108182ae1e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.788169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f2ad557-da14-445e-9d56-5b108182ae1e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.788608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f2ad557-da14-445e-9d56-5b108182ae1e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.789303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f2ad557-da14-445e-9d56-5b108182ae1e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.789763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f2ad557-da14-445e-9d56-5b108182ae1e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.790224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f2ad557-da14-445e-9d56-5b108182ae1e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.922138 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5f2ad557-da14-445e-9d56-5b108182ae1e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:22.929904 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5f2ad557-da14-445e-9d56-5b108182ae1e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.153719 Aug 10 23:22:22.930464 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 394/780] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:22 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:23.058197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-0eeef332-1995-4075-a4e2-db450888c3ea req-c78fca48-308c-4f96-93be-101daa9ddc92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40168342-ce20-4df4-9112-60c03c657239", "name": "network-vif-plugged", "status": "completed", "tag": "33300b87-970b-4a82-b42e-51c6998b535a"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:23.067893 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-0eeef332-1995-4075-a4e2-db450888c3ea req-c78fca48-308c-4f96-93be-101daa9ddc92 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.068408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-0eeef332-1995-4075-a4e2-db450888c3ea req-c78fca48-308c-4f96-93be-101daa9ddc92 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.068848 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-0eeef332-1995-4075-a4e2-db450888c3ea req-c78fca48-308c-4f96-93be-101daa9ddc92 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.080263 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-0eeef332-1995-4075-a4e2-db450888c3ea req-c78fca48-308c-4f96-93be-101daa9ddc92 service nova] Creating event network-vif-plugged:33300b87-970b-4a82-b42e-51c6998b535a for instance 40168342-ce20-4df4-9112-60c03c657239 on hv-cinder-85144 Aug 10 23:22:23.085264 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-0eeef332-1995-4075-a4e2-db450888c3ea req-c78fca48-308c-4f96-93be-101daa9ddc92 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030685 Aug 10 23:22:23.085868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 387/781] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:23.119280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:23.120001 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:23.127925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.128571 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.129066 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.129896 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.130406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.131011 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.267394 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:23.276371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:23.277879 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:23.279596 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-04ac94f3-d26e-4aed-9280-817d221d1ffd tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.165323 Aug 10 23:22:23.280158 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 395/782] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:23 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:23.951999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-301dcd44-fee3-4be3-8614-fe47dec3d883 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:23.952742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-301dcd44-fee3-4be3-8614-fe47dec3d883 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:23.954718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:23.959733 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-301dcd44-fee3-4be3-8614-fe47dec3d883 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.960221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-301dcd44-fee3-4be3-8614-fe47dec3d883 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.960660 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-301dcd44-fee3-4be3-8614-fe47dec3d883 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.961357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-301dcd44-fee3-4be3-8614-fe47dec3d883 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.961817 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-301dcd44-fee3-4be3-8614-fe47dec3d883 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.962296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-301dcd44-fee3-4be3-8614-fe47dec3d883 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.966448 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:24.093127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-301dcd44-fee3-4be3-8614-fe47dec3d883 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:24.100771 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-301dcd44-fee3-4be3-8614-fe47dec3d883 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.153708 Aug 10 23:22:24.101334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 388/783] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:23 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:24.301983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:24.302636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:24.309654 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:24.310115 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:24.310550 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:24.311265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:24.311726 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:24.312149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:24.443684 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:24.451670 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:24.453225 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:24.454361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-85b7b966-361b-48cd-bbf9-9eabf1c0740b tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.156305 Aug 10 23:22:24.454949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 396/784] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:24 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:25.121829 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ef41ce10-9c21-4299-a48c-97941fee7d87 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:25.122445 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ef41ce10-9c21-4299-a48c-97941fee7d87 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:25.128960 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef41ce10-9c21-4299-a48c-97941fee7d87 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:25.129441 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef41ce10-9c21-4299-a48c-97941fee7d87 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:25.129890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef41ce10-9c21-4299-a48c-97941fee7d87 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:25.130588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef41ce10-9c21-4299-a48c-97941fee7d87 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:25.131074 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef41ce10-9c21-4299-a48c-97941fee7d87 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:25.131501 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ef41ce10-9c21-4299-a48c-97941fee7d87 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:25.264563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ef41ce10-9c21-4299-a48c-97941fee7d87 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:25.272196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ef41ce10-9c21-4299-a48c-97941fee7d87 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.154582 Aug 10 23:22:25.272771 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 389/785] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:25 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:25.478365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:25.478974 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:25.485437 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:25.485911 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:25.486341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:25.487055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:25.487501 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:25.487919 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:25.619447 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:25.628084 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:25.629629 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:25.630791 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1be375d8-13c2-42c5-9bcc-cd56aad1aaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.156590 Aug 10 23:22:25.631340 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 397/786] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:25 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:26.295248 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b228fe69-9c93-48cd-a932-61d9b7671521 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:26.295989 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b228fe69-9c93-48cd-a932-61d9b7671521 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:26.302762 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b228fe69-9c93-48cd-a932-61d9b7671521 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:26.303242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b228fe69-9c93-48cd-a932-61d9b7671521 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:26.303675 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b228fe69-9c93-48cd-a932-61d9b7671521 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:26.304373 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b228fe69-9c93-48cd-a932-61d9b7671521 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:26.304822 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b228fe69-9c93-48cd-a932-61d9b7671521 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:26.305238 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b228fe69-9c93-48cd-a932-61d9b7671521 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:26.456557 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b228fe69-9c93-48cd-a932-61d9b7671521 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:26.464325 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b228fe69-9c93-48cd-a932-61d9b7671521 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.174808 Aug 10 23:22:26.468146 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 390/787] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:26 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:26.653984 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:26.654593 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:26.663324 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:26.663981 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:26.664546 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:26.665347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:26.665910 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:26.666433 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:26.797673 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:26.805753 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:26.807294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:26.808481 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cd95ca96-725c-4cd7-8d43-1cb8021bcaea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1731 microversion: 2.20 time: 0.158444 Aug 10 23:22:26.809036 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 398/788] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:26 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:27.485951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-52a0e938-65ce-4eb1-a362-e8ed694e99b2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:27.486567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-52a0e938-65ce-4eb1-a362-e8ed694e99b2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:27.493060 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52a0e938-65ce-4eb1-a362-e8ed694e99b2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:27.493546 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52a0e938-65ce-4eb1-a362-e8ed694e99b2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:27.493986 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52a0e938-65ce-4eb1-a362-e8ed694e99b2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:27.494808 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52a0e938-65ce-4eb1-a362-e8ed694e99b2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:27.495180 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52a0e938-65ce-4eb1-a362-e8ed694e99b2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:27.495607 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-52a0e938-65ce-4eb1-a362-e8ed694e99b2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:27.627403 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-52a0e938-65ce-4eb1-a362-e8ed694e99b2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:27.634921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-52a0e938-65ce-4eb1-a362-e8ed694e99b2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.152871 Aug 10 23:22:27.635490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 391/789] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:27 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:27.831348 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:27.831965 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:27.838607 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:27.839127 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:27.839568 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:27.840275 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:27.840732 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:27.841162 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:27.969267 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:27.977229 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:27.978853 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:27.980012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ef77dbec-f2cd-42b6-89d9-0db61ae29710 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1718 microversion: 2.20 time: 0.152605 Aug 10 23:22:27.981059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 399/790] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:27 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:28.565653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-12a0556b-9a0b-41a6-b583-57663686d764 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:28.572106 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-12a0556b-9a0b-41a6-b583-57663686d764 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:28.572667 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-12a0556b-9a0b-41a6-b583-57663686d764 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:28.573111 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-12a0556b-9a0b-41a6-b583-57663686d764 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:28.632430 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-12a0556b-9a0b-41a6-b583-57663686d764 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Going to try to stop instance {{(pid=121333) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:22:28.656148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-079d1447-51cd-4b83-be5a-256c47353aa3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:28.656767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-079d1447-51cd-4b83-be5a-256c47353aa3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:28.662791 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-079d1447-51cd-4b83-be5a-256c47353aa3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:28.666851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-079d1447-51cd-4b83-be5a-256c47353aa3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:28.666851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-079d1447-51cd-4b83-be5a-256c47353aa3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:28.666851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-079d1447-51cd-4b83-be5a-256c47353aa3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:28.666851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-079d1447-51cd-4b83-be5a-256c47353aa3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:28.667231 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-079d1447-51cd-4b83-be5a-256c47353aa3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:28.797730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-079d1447-51cd-4b83-be5a-256c47353aa3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:28.805399 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-079d1447-51cd-4b83-be5a-256c47353aa3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.153748 Aug 10 23:22:28.805976 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 400/791] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:28 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:28.852109 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-12a0556b-9a0b-41a6-b583-57663686d764 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/action" status: 202 len: 0 microversion: 2.1 time: 0.290092 Aug 10 23:22:28.852715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 392/792] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:22:28 2022] POST /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:22:28.861141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-bf777630-fdde-4a35-bf9e-e0f74d4180a2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:28.861790 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bf777630-fdde-4a35-bf9e-e0f74d4180a2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:28.868253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf777630-fdde-4a35-bf9e-e0f74d4180a2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:28.868737 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf777630-fdde-4a35-bf9e-e0f74d4180a2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:28.869260 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf777630-fdde-4a35-bf9e-e0f74d4180a2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:28.869881 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf777630-fdde-4a35-bf9e-e0f74d4180a2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:28.870340 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf777630-fdde-4a35-bf9e-e0f74d4180a2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:28.870801 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf777630-fdde-4a35-bf9e-e0f74d4180a2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:29.003563 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-bf777630-fdde-4a35-bf9e-e0f74d4180a2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:29.008091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-bf777630-fdde-4a35-bf9e-e0f74d4180a2 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.150709 Aug 10 23:22:29.008941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 401/793] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:28 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:29.826419 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6a0da9c5-4a19-471c-9b6d-0853c27239b9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:29.827066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6a0da9c5-4a19-471c-9b6d-0853c27239b9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:29.833181 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6a0da9c5-4a19-471c-9b6d-0853c27239b9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:29.833662 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6a0da9c5-4a19-471c-9b6d-0853c27239b9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:29.834100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6a0da9c5-4a19-471c-9b6d-0853c27239b9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:29.834827 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6a0da9c5-4a19-471c-9b6d-0853c27239b9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:29.835293 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6a0da9c5-4a19-471c-9b6d-0853c27239b9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:29.835721 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6a0da9c5-4a19-471c-9b6d-0853c27239b9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:29.965389 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6a0da9c5-4a19-471c-9b6d-0853c27239b9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:29.972775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6a0da9c5-4a19-471c-9b6d-0853c27239b9 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.151170 Aug 10 23:22:29.973338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 393/794] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:29 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:30.029743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d9e593b8-504c-472f-8cff-d6729cf26fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:30.030361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d9e593b8-504c-472f-8cff-d6729cf26fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:30.036803 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d9e593b8-504c-472f-8cff-d6729cf26fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:30.037315 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d9e593b8-504c-472f-8cff-d6729cf26fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:30.037755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d9e593b8-504c-472f-8cff-d6729cf26fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:30.038453 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d9e593b8-504c-472f-8cff-d6729cf26fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:30.038937 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d9e593b8-504c-472f-8cff-d6729cf26fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:30.039368 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d9e593b8-504c-472f-8cff-d6729cf26fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:30.170220 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d9e593b8-504c-472f-8cff-d6729cf26fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:30.178002 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d9e593b8-504c-472f-8cff-d6729cf26fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.152662 Aug 10 23:22:30.178562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 402/795] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:30 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:30.994337 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-43b0c564-a3b8-4bc6-85b5-3c1498055c0c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:30.994918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-43b0c564-a3b8-4bc6-85b5-3c1498055c0c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:31.001384 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43b0c564-a3b8-4bc6-85b5-3c1498055c0c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:31.001870 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43b0c564-a3b8-4bc6-85b5-3c1498055c0c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:31.002319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43b0c564-a3b8-4bc6-85b5-3c1498055c0c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:31.003053 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43b0c564-a3b8-4bc6-85b5-3c1498055c0c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:31.003537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43b0c564-a3b8-4bc6-85b5-3c1498055c0c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:31.003971 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43b0c564-a3b8-4bc6-85b5-3c1498055c0c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:31.136336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-43b0c564-a3b8-4bc6-85b5-3c1498055c0c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:31.144549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-43b0c564-a3b8-4bc6-85b5-3c1498055c0c tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.154320 Aug 10 23:22:31.145123 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 394/796] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:30 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:31.198483 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0a9b2e9d-9fb0-44df-a80e-3c586242a23f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:31.199694 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0a9b2e9d-9fb0-44df-a80e-3c586242a23f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:31.206031 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0a9b2e9d-9fb0-44df-a80e-3c586242a23f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:31.206506 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0a9b2e9d-9fb0-44df-a80e-3c586242a23f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:31.206972 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0a9b2e9d-9fb0-44df-a80e-3c586242a23f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:31.207668 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0a9b2e9d-9fb0-44df-a80e-3c586242a23f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:31.208117 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0a9b2e9d-9fb0-44df-a80e-3c586242a23f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:31.208784 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0a9b2e9d-9fb0-44df-a80e-3c586242a23f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:31.339329 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0a9b2e9d-9fb0-44df-a80e-3c586242a23f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:31.347898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0a9b2e9d-9fb0-44df-a80e-3c586242a23f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.153296 Aug 10 23:22:31.348462 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 403/797] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:31 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:32.166240 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-51fd56d0-8823-4d8e-9353-6e7d1bc2c93b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:32.166918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-51fd56d0-8823-4d8e-9353-6e7d1bc2c93b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:32.174006 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51fd56d0-8823-4d8e-9353-6e7d1bc2c93b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:32.174493 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51fd56d0-8823-4d8e-9353-6e7d1bc2c93b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:32.174962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51fd56d0-8823-4d8e-9353-6e7d1bc2c93b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:32.175664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51fd56d0-8823-4d8e-9353-6e7d1bc2c93b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:32.176123 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51fd56d0-8823-4d8e-9353-6e7d1bc2c93b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:32.176553 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-51fd56d0-8823-4d8e-9353-6e7d1bc2c93b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:32.303732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-51fd56d0-8823-4d8e-9353-6e7d1bc2c93b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:32.311714 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-51fd56d0-8823-4d8e-9353-6e7d1bc2c93b tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.149344 Aug 10 23:22:32.312350 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 395/798] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:32 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:32.369115 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-bfdfd05a-6573-436a-9e97-04b0ccf79b21 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:32.369728 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bfdfd05a-6573-436a-9e97-04b0ccf79b21 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:32.377061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfdfd05a-6573-436a-9e97-04b0ccf79b21 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:32.377549 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfdfd05a-6573-436a-9e97-04b0ccf79b21 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:32.377986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfdfd05a-6573-436a-9e97-04b0ccf79b21 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:32.378702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfdfd05a-6573-436a-9e97-04b0ccf79b21 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:32.379167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfdfd05a-6573-436a-9e97-04b0ccf79b21 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:32.379697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bfdfd05a-6573-436a-9e97-04b0ccf79b21 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:32.515494 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-bfdfd05a-6573-436a-9e97-04b0ccf79b21 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:32.523475 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-bfdfd05a-6573-436a-9e97-04b0ccf79b21 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.158255 Aug 10 23:22:32.524040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 404/799] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:32 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:33.078609 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-24b5df04-6972-4950-83ad-8a2a5fec7ff0 req-5921f394-d724-4995-a7af-c4d4bb1646b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace5e95d-7b24-4111-ae18-7185b8662c79", "name": "network-vif-plugged", "status": "completed", "tag": "cd7e7501-d9b2-4b2f-9318-8204c144c269"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:33.087730 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-24b5df04-6972-4950-83ad-8a2a5fec7ff0 req-5921f394-d724-4995-a7af-c4d4bb1646b3 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:33.088465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-24b5df04-6972-4950-83ad-8a2a5fec7ff0 req-5921f394-d724-4995-a7af-c4d4bb1646b3 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:33.088899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-24b5df04-6972-4950-83ad-8a2a5fec7ff0 req-5921f394-d724-4995-a7af-c4d4bb1646b3 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:33.102898 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-24b5df04-6972-4950-83ad-8a2a5fec7ff0 req-5921f394-d724-4995-a7af-c4d4bb1646b3 service nova] Creating event network-vif-plugged:cd7e7501-d9b2-4b2f-9318-8204c144c269 for instance ace5e95d-7b24-4111-ae18-7185b8662c79 on hv-cinder-85144 Aug 10 23:22:33.108289 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-24b5df04-6972-4950-83ad-8a2a5fec7ff0 req-5921f394-d724-4995-a7af-c4d4bb1646b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033297 Aug 10 23:22:33.108894 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 396/800] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:33.333156 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-64d18a71-4beb-4bee-8664-174ece18adfd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:33.333939 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-64d18a71-4beb-4bee-8664-174ece18adfd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:33.341142 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d18a71-4beb-4bee-8664-174ece18adfd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:33.341632 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d18a71-4beb-4bee-8664-174ece18adfd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:33.342069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d18a71-4beb-4bee-8664-174ece18adfd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:33.342806 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d18a71-4beb-4bee-8664-174ece18adfd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:33.343264 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d18a71-4beb-4bee-8664-174ece18adfd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:33.343698 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-64d18a71-4beb-4bee-8664-174ece18adfd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:33.520910 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-64d18a71-4beb-4bee-8664-174ece18adfd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:33.529038 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-64d18a71-4beb-4bee-8664-174ece18adfd tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.199784 Aug 10 23:22:33.532365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 405/801] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:33 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:33.544975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-26ae1323-1003-4f16-9cec-e98e71efdc8a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:33.545677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-26ae1323-1003-4f16-9cec-e98e71efdc8a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:33.551913 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26ae1323-1003-4f16-9cec-e98e71efdc8a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:33.552388 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26ae1323-1003-4f16-9cec-e98e71efdc8a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:33.552816 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26ae1323-1003-4f16-9cec-e98e71efdc8a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:33.553507 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26ae1323-1003-4f16-9cec-e98e71efdc8a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:33.553956 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26ae1323-1003-4f16-9cec-e98e71efdc8a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:33.554374 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-26ae1323-1003-4f16-9cec-e98e71efdc8a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:33.686168 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-26ae1323-1003-4f16-9cec-e98e71efdc8a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:33.693994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-26ae1323-1003-4f16-9cec-e98e71efdc8a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.153828 Aug 10 23:22:33.694566 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 397/802] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:33 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:34.550122 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e03674a6-71bd-4f41-a84d-5f3dbc7f5b74 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:34.550765 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e03674a6-71bd-4f41-a84d-5f3dbc7f5b74 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:34.557167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e03674a6-71bd-4f41-a84d-5f3dbc7f5b74 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:34.557649 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e03674a6-71bd-4f41-a84d-5f3dbc7f5b74 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:34.558090 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e03674a6-71bd-4f41-a84d-5f3dbc7f5b74 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:34.558825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e03674a6-71bd-4f41-a84d-5f3dbc7f5b74 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:34.559286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e03674a6-71bd-4f41-a84d-5f3dbc7f5b74 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:34.559712 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e03674a6-71bd-4f41-a84d-5f3dbc7f5b74 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:34.688865 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e03674a6-71bd-4f41-a84d-5f3dbc7f5b74 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:34.696298 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e03674a6-71bd-4f41-a84d-5f3dbc7f5b74 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1574 microversion: 2.1 time: 0.150086 Aug 10 23:22:34.696859 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 406/803] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:34 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:34.715217 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dd38e094-822d-499e-858b-6957ca677483 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:34.715840 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dd38e094-822d-499e-858b-6957ca677483 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:34.722632 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd38e094-822d-499e-858b-6957ca677483 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:34.723156 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd38e094-822d-499e-858b-6957ca677483 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:34.723598 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd38e094-822d-499e-858b-6957ca677483 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:34.724302 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd38e094-822d-499e-858b-6957ca677483 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:34.724765 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd38e094-822d-499e-858b-6957ca677483 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:34.725196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd38e094-822d-499e-858b-6957ca677483 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:35.096856 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-dd38e094-822d-499e-858b-6957ca677483 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:35.104810 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dd38e094-822d-499e-858b-6957ca677483 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.394179 Aug 10 23:22:35.105425 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 398/804] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:34 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:35.718577 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-fc3a7d52-ab82-45ae-bd1e-505c0bc9b2b1 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:35.719216 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-fc3a7d52-ab82-45ae-bd1e-505c0bc9b2b1 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:35.725838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc3a7d52-ab82-45ae-bd1e-505c0bc9b2b1 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:35.726322 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc3a7d52-ab82-45ae-bd1e-505c0bc9b2b1 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:35.726810 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc3a7d52-ab82-45ae-bd1e-505c0bc9b2b1 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:35.727508 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc3a7d52-ab82-45ae-bd1e-505c0bc9b2b1 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:35.727994 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc3a7d52-ab82-45ae-bd1e-505c0bc9b2b1 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:35.728445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-fc3a7d52-ab82-45ae-bd1e-505c0bc9b2b1 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:35.855989 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-fc3a7d52-ab82-45ae-bd1e-505c0bc9b2b1 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:35.863436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-fc3a7d52-ab82-45ae-bd1e-505c0bc9b2b1 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1561 microversion: 2.1 time: 0.149729 Aug 10 23:22:35.864008 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 407/805] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:35 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:36.125901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a27085d7-f389-4870-ba3a-26c808070354 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:36.126497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a27085d7-f389-4870-ba3a-26c808070354 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:36.132939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a27085d7-f389-4870-ba3a-26c808070354 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:36.133420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a27085d7-f389-4870-ba3a-26c808070354 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:36.133857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a27085d7-f389-4870-ba3a-26c808070354 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:36.134549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a27085d7-f389-4870-ba3a-26c808070354 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:36.135042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a27085d7-f389-4870-ba3a-26c808070354 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:36.135462 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a27085d7-f389-4870-ba3a-26c808070354 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:36.266580 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a27085d7-f389-4870-ba3a-26c808070354 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:36.274512 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a27085d7-f389-4870-ba3a-26c808070354 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.152466 Aug 10 23:22:36.275091 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 399/806] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:36 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:37.295895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7eb29025-0476-4da2-9794-15319311955f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:37.296513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7eb29025-0476-4da2-9794-15319311955f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:37.303027 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb29025-0476-4da2-9794-15319311955f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:37.303512 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb29025-0476-4da2-9794-15319311955f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:37.303947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb29025-0476-4da2-9794-15319311955f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:37.304636 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb29025-0476-4da2-9794-15319311955f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:37.305087 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb29025-0476-4da2-9794-15319311955f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:37.305508 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7eb29025-0476-4da2-9794-15319311955f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:37.310178 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=100 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:37.442127 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7eb29025-0476-4da2-9794-15319311955f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:37.450264 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7eb29025-0476-4da2-9794-15319311955f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.158783 Aug 10 23:22:37.450870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 408/807] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:37 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:38.471697 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1553a637-66ca-44b6-bae0-2a62ae1c26f1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:38.472319 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1553a637-66ca-44b6-bae0-2a62ae1c26f1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:38.479037 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1553a637-66ca-44b6-bae0-2a62ae1c26f1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:38.479531 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1553a637-66ca-44b6-bae0-2a62ae1c26f1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:38.480478 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1553a637-66ca-44b6-bae0-2a62ae1c26f1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:38.481227 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1553a637-66ca-44b6-bae0-2a62ae1c26f1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:38.481689 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1553a637-66ca-44b6-bae0-2a62ae1c26f1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:38.482119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1553a637-66ca-44b6-bae0-2a62ae1c26f1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:38.612004 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1553a637-66ca-44b6-bae0-2a62ae1c26f1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:38.619934 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1553a637-66ca-44b6-bae0-2a62ae1c26f1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.152155 Aug 10 23:22:38.620499 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 400/808] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:38 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:39.641376 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-95bc565a-f7d0-4f11-85c4-b61727949687 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:39.641995 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-95bc565a-f7d0-4f11-85c4-b61727949687 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:39.648537 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-95bc565a-f7d0-4f11-85c4-b61727949687 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:39.649021 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-95bc565a-f7d0-4f11-85c4-b61727949687 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:39.649460 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-95bc565a-f7d0-4f11-85c4-b61727949687 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:39.650155 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-95bc565a-f7d0-4f11-85c4-b61727949687 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:39.650613 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-95bc565a-f7d0-4f11-85c4-b61727949687 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:39.651072 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-95bc565a-f7d0-4f11-85c4-b61727949687 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:39.786289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-95bc565a-f7d0-4f11-85c4-b61727949687 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:39.794789 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-95bc565a-f7d0-4f11-85c4-b61727949687 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.157217 Aug 10 23:22:39.795353 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 409/809] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:39 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:40.817345 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8372cfb1-c4dd-4bb1-8b57-1e7d5630bce5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:40.817874 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8372cfb1-c4dd-4bb1-8b57-1e7d5630bce5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:40.824308 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8372cfb1-c4dd-4bb1-8b57-1e7d5630bce5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:40.824795 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8372cfb1-c4dd-4bb1-8b57-1e7d5630bce5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:40.825216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8372cfb1-c4dd-4bb1-8b57-1e7d5630bce5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:40.825904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8372cfb1-c4dd-4bb1-8b57-1e7d5630bce5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:40.826352 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8372cfb1-c4dd-4bb1-8b57-1e7d5630bce5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:40.826803 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8372cfb1-c4dd-4bb1-8b57-1e7d5630bce5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:40.953426 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8372cfb1-c4dd-4bb1-8b57-1e7d5630bce5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:40.961287 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8372cfb1-c4dd-4bb1-8b57-1e7d5630bce5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.147834 Aug 10 23:22:40.961849 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 401/810] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:40 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:41.982753 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-89977719-b877-4d37-a0e9-24efea38b973 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:41.983822 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-89977719-b877-4d37-a0e9-24efea38b973 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:41.990265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-89977719-b877-4d37-a0e9-24efea38b973 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:41.990816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-89977719-b877-4d37-a0e9-24efea38b973 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:41.991284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-89977719-b877-4d37-a0e9-24efea38b973 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:41.991993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-89977719-b877-4d37-a0e9-24efea38b973 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:41.992451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-89977719-b877-4d37-a0e9-24efea38b973 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:41.992879 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-89977719-b877-4d37-a0e9-24efea38b973 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:42.136675 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-89977719-b877-4d37-a0e9-24efea38b973 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:42.145907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-89977719-b877-4d37-a0e9-24efea38b973 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.167041 Aug 10 23:22:42.146472 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 410/811] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:41 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:43.166923 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5b332dd4-318e-423d-807e-db8af5d728df tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:43.167472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5b332dd4-318e-423d-807e-db8af5d728df tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:43.173950 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b332dd4-318e-423d-807e-db8af5d728df tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:43.174434 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b332dd4-318e-423d-807e-db8af5d728df tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:43.174911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b332dd4-318e-423d-807e-db8af5d728df tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:43.175607 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b332dd4-318e-423d-807e-db8af5d728df tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:43.176066 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b332dd4-318e-423d-807e-db8af5d728df tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:43.176494 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5b332dd4-318e-423d-807e-db8af5d728df tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:43.301276 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5b332dd4-318e-423d-807e-db8af5d728df tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:43.309206 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5b332dd4-318e-423d-807e-db8af5d728df tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.146324 Aug 10 23:22:43.309801 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 402/812] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:43 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:44.331678 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e4b79659-4a20-4de2-a9c5-97ac2e0445e1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:44.332321 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e4b79659-4a20-4de2-a9c5-97ac2e0445e1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:44.339032 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e4b79659-4a20-4de2-a9c5-97ac2e0445e1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:44.339554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e4b79659-4a20-4de2-a9c5-97ac2e0445e1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:44.339987 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e4b79659-4a20-4de2-a9c5-97ac2e0445e1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:44.340678 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e4b79659-4a20-4de2-a9c5-97ac2e0445e1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:44.341136 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e4b79659-4a20-4de2-a9c5-97ac2e0445e1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:44.341546 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e4b79659-4a20-4de2-a9c5-97ac2e0445e1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:44.484175 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e4b79659-4a20-4de2-a9c5-97ac2e0445e1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:44.492087 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e4b79659-4a20-4de2-a9c5-97ac2e0445e1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1721 microversion: 2.1 time: 0.164609 Aug 10 23:22:44.492658 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 411/813] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:44 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:45.513088 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6cc12fc1-fbcd-4cb7-b4d0-60fb44ea974c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:45.513689 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6cc12fc1-fbcd-4cb7-b4d0-60fb44ea974c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:45.520483 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6cc12fc1-fbcd-4cb7-b4d0-60fb44ea974c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:45.520993 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6cc12fc1-fbcd-4cb7-b4d0-60fb44ea974c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:45.521427 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6cc12fc1-fbcd-4cb7-b4d0-60fb44ea974c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:45.522235 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6cc12fc1-fbcd-4cb7-b4d0-60fb44ea974c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:45.522724 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6cc12fc1-fbcd-4cb7-b4d0-60fb44ea974c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:45.523155 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6cc12fc1-fbcd-4cb7-b4d0-60fb44ea974c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:45.708387 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6cc12fc1-fbcd-4cb7-b4d0-60fb44ea974c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:45.719099 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6cc12fc1-fbcd-4cb7-b4d0-60fb44ea974c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1698 microversion: 2.1 time: 0.209893 Aug 10 23:22:45.719672 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 403/814] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:45 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1698 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:45.739795 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f6e4da48-c8e2-43ae-873d-d17227059375 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:45.742249 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=50 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:45.746956 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f6e4da48-c8e2-43ae-873d-d17227059375 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:45.747439 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f6e4da48-c8e2-43ae-873d-d17227059375 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:45.747876 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f6e4da48-c8e2-43ae-873d-d17227059375 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:45.806006 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f6e4da48-c8e2-43ae-873d-d17227059375 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Going to try to start instance {{(pid=121332) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 23:22:46.050835 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f6e4da48-c8e2-43ae-873d-d17227059375 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/action" status: 202 len: 0 microversion: 2.1 time: 0.314631 Aug 10 23:22:46.051461 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 412/815] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:22:45 2022] POST /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:22:46.059670 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-419971d7-5cd4-48d9-b113-91121c13efb3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:46.060279 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-419971d7-5cd4-48d9-b113-91121c13efb3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:46.066181 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-419971d7-5cd4-48d9-b113-91121c13efb3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:46.066678 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-419971d7-5cd4-48d9-b113-91121c13efb3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:46.067123 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-419971d7-5cd4-48d9-b113-91121c13efb3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:46.067810 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-419971d7-5cd4-48d9-b113-91121c13efb3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:46.068259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-419971d7-5cd4-48d9-b113-91121c13efb3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:46.068680 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-419971d7-5cd4-48d9-b113-91121c13efb3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:46.084267 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:46.207070 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-419971d7-5cd4-48d9-b113-91121c13efb3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:46.215958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-419971d7-5cd4-48d9-b113-91121c13efb3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1707 microversion: 2.1 time: 0.160191 Aug 10 23:22:46.216582 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 404/816] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:46 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:47.238224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8803fd98-20c8-461c-991d-15081c117d62 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:47.238940 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8803fd98-20c8-461c-991d-15081c117d62 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:47.245068 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8803fd98-20c8-461c-991d-15081c117d62 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:47.246096 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8803fd98-20c8-461c-991d-15081c117d62 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:47.246646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8803fd98-20c8-461c-991d-15081c117d62 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:47.247358 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8803fd98-20c8-461c-991d-15081c117d62 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:47.247808 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8803fd98-20c8-461c-991d-15081c117d62 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:47.248227 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8803fd98-20c8-461c-991d-15081c117d62 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:47.376382 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8803fd98-20c8-461c-991d-15081c117d62 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:47.384603 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8803fd98-20c8-461c-991d-15081c117d62 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1707 microversion: 2.1 time: 0.151062 Aug 10 23:22:47.394406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 413/817] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:47 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1707 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:48.405264 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a610fc88-75d2-402d-9afc-bcf96cc352d5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:48.405878 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a610fc88-75d2-402d-9afc-bcf96cc352d5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:48.412879 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a610fc88-75d2-402d-9afc-bcf96cc352d5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:48.413359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a610fc88-75d2-402d-9afc-bcf96cc352d5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:48.413795 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a610fc88-75d2-402d-9afc-bcf96cc352d5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:48.414491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a610fc88-75d2-402d-9afc-bcf96cc352d5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:48.414978 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a610fc88-75d2-402d-9afc-bcf96cc352d5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:48.415406 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a610fc88-75d2-402d-9afc-bcf96cc352d5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:48.551783 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a610fc88-75d2-402d-9afc-bcf96cc352d5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:48.560432 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a610fc88-75d2-402d-9afc-bcf96cc352d5 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1711 microversion: 2.1 time: 0.159034 Aug 10 23:22:48.560997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 405/818] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:48 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1711 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:04.818384 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f195023f-409b-4323-8dec-73e29f44bf59 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:04.818975 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f195023f-409b-4323-8dec-73e29f44bf59 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:04.821035 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:04.821797 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:04.826753 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f195023f-409b-4323-8dec-73e29f44bf59 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:04.827242 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f195023f-409b-4323-8dec-73e29f44bf59 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:04.827678 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f195023f-409b-4323-8dec-73e29f44bf59 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:04.828379 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f195023f-409b-4323-8dec-73e29f44bf59 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:04.828831 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f195023f-409b-4323-8dec-73e29f44bf59 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:04.829255 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f195023f-409b-4323-8dec-73e29f44bf59 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:04.851854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f195023f-409b-4323-8dec-73e29f44bf59 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/ips" status: 200 len: 151 microversion: 2.1 time: 0.037349 Aug 10 23:23:04.852556 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 414/819] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 10 23:23:04 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:06.415398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-22d12efd-1701-4ab3-9b8e-7c0a530d6b76 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e395179f-df96-489d-9956-969d5b20b261"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:06.417782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-22d12efd-1701-4ab3-9b8e-7c0a530d6b76 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:06.420569 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=35 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:06.435127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=9 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:06.435127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22d12efd-1701-4ab3-9b8e-7c0a530d6b76 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:06.435127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22d12efd-1701-4ab3-9b8e-7c0a530d6b76 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:06.435127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22d12efd-1701-4ab3-9b8e-7c0a530d6b76 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:06.436107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22d12efd-1701-4ab3-9b8e-7c0a530d6b76 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:06.436107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22d12efd-1701-4ab3-9b8e-7c0a530d6b76 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:06.436107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-22d12efd-1701-4ab3-9b8e-7c0a530d6b76 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:07.166300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-22d12efd-1701-4ab3-9b8e-7c0a530d6b76 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "POST /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754674 Aug 10 23:23:07.167006 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 406/820] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:23:06 2022] POST /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:14.791338 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e499eade-8b91-4311-9702-9acfd45cb968 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:14.791868 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e499eade-8b91-4311-9702-9acfd45cb968 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:14.799434 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e499eade-8b91-4311-9702-9acfd45cb968 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:14.799959 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e499eade-8b91-4311-9702-9acfd45cb968 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:14.800391 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e499eade-8b91-4311-9702-9acfd45cb968 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:14.801079 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e499eade-8b91-4311-9702-9acfd45cb968 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:14.801537 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e499eade-8b91-4311-9702-9acfd45cb968 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:14.801958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e499eade-8b91-4311-9702-9acfd45cb968 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:14.883642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-e499eade-8b91-4311-9702-9acfd45cb968 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lazy-loading 'services' on Instance uuid 4400e6b6-97d1-400f-9a8d-2c9db7c77042 {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:23:15.150294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e499eade-8b91-4311-9702-9acfd45cb968 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-volume_attachments/e395179f-df96-489d-9956-969d5b20b261" status: 202 len: 0 microversion: 2.1 time: 0.362688 Aug 10 23:23:15.150935 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 415/821] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:23:14 2022] DELETE /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-volume_attachments/e395179f-df96-489d-9956-969d5b20b261 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:23:15.160622 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-217dc3ee-cce2-472b-8d95-99d3cb413549 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:15.163003 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-217dc3ee-cce2-472b-8d95-99d3cb413549 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:15.169541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-217dc3ee-cce2-472b-8d95-99d3cb413549 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:15.170027 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-217dc3ee-cce2-472b-8d95-99d3cb413549 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:15.171071 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-217dc3ee-cce2-472b-8d95-99d3cb413549 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:15.171779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-217dc3ee-cce2-472b-8d95-99d3cb413549 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:15.172241 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-217dc3ee-cce2-472b-8d95-99d3cb413549 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:15.172669 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-217dc3ee-cce2-472b-8d95-99d3cb413549 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:15.201652 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-217dc3ee-cce2-472b-8d95-99d3cb413549 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046078 Aug 10 23:23:15.202213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 407/822] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:23:15 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:16.214347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c4b3d25a-7ef2-4b02-9342-2c1955e2f538 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:16.216725 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c4b3d25a-7ef2-4b02-9342-2c1955e2f538 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:16.223993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c4b3d25a-7ef2-4b02-9342-2c1955e2f538 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:16.224469 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c4b3d25a-7ef2-4b02-9342-2c1955e2f538 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:16.224901 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c4b3d25a-7ef2-4b02-9342-2c1955e2f538 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:16.225583 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c4b3d25a-7ef2-4b02-9342-2c1955e2f538 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:16.226036 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c4b3d25a-7ef2-4b02-9342-2c1955e2f538 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:16.226454 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c4b3d25a-7ef2-4b02-9342-2c1955e2f538 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:16.254604 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c4b3d25a-7ef2-4b02-9342-2c1955e2f538 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 Aug 10 23:23:16.255097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 416/823] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:23:16 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:23:17.266593 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-11920964-625d-4753-a249-8deefe93ceeb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:17.268826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-11920964-625d-4753-a249-8deefe93ceeb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:17.275334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11920964-625d-4753-a249-8deefe93ceeb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:17.275951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11920964-625d-4753-a249-8deefe93ceeb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:17.276293 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11920964-625d-4753-a249-8deefe93ceeb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:17.276990 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11920964-625d-4753-a249-8deefe93ceeb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:17.277445 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11920964-625d-4753-a249-8deefe93ceeb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:17.277871 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-11920964-625d-4753-a249-8deefe93ceeb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:17.306946 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-11920964-625d-4753-a249-8deefe93ceeb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044415 Aug 10 23:23:17.307507 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 408/824] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:23:17 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:23:17.370105 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-469377c5-26f3-47ee-8a97-6f6739ee5b6f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:17.370642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-469377c5-26f3-47ee-8a97-6f6739ee5b6f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:17.377043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-469377c5-26f3-47ee-8a97-6f6739ee5b6f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:17.377526 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-469377c5-26f3-47ee-8a97-6f6739ee5b6f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:17.380707 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-469377c5-26f3-47ee-8a97-6f6739ee5b6f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:17.380707 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-469377c5-26f3-47ee-8a97-6f6739ee5b6f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:17.380707 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-469377c5-26f3-47ee-8a97-6f6739ee5b6f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:17.380707 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-469377c5-26f3-47ee-8a97-6f6739ee5b6f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:17.405513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-469377c5-26f3-47ee-8a97-6f6739ee5b6f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:23:17.756672 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-469377c5-26f3-47ee-8a97-6f6739ee5b6f tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 204 len: 0 microversion: 2.1 time: 0.390150 Aug 10 23:23:17.757258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 417/825] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:23:17 2022] DELETE /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:23:17.765972 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-42022fe2-72f6-427f-b894-01d85ae02ab1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:17.768438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-42022fe2-72f6-427f-b894-01d85ae02ab1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:17.772652 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42022fe2-72f6-427f-b894-01d85ae02ab1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:17.773134 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42022fe2-72f6-427f-b894-01d85ae02ab1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:17.773566 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42022fe2-72f6-427f-b894-01d85ae02ab1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:17.774258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42022fe2-72f6-427f-b894-01d85ae02ab1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:17.774736 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42022fe2-72f6-427f-b894-01d85ae02ab1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:17.775161 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-42022fe2-72f6-427f-b894-01d85ae02ab1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:17.915755 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-42022fe2-72f6-427f-b894-01d85ae02ab1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:17.923239 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-42022fe2-72f6-427f-b894-01d85ae02ab1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1682 microversion: 2.1 time: 0.161602 Aug 10 23:23:17.923809 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 409/826] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:17 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:18.945444 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a7d01988-f227-49fd-8b3e-3a58cfdef852 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:18.946144 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a7d01988-f227-49fd-8b3e-3a58cfdef852 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:18.953022 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a7d01988-f227-49fd-8b3e-3a58cfdef852 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:18.953503 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a7d01988-f227-49fd-8b3e-3a58cfdef852 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:18.953941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a7d01988-f227-49fd-8b3e-3a58cfdef852 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:18.954638 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a7d01988-f227-49fd-8b3e-3a58cfdef852 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:18.955120 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a7d01988-f227-49fd-8b3e-3a58cfdef852 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:18.955544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a7d01988-f227-49fd-8b3e-3a58cfdef852 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:19.084133 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a7d01988-f227-49fd-8b3e-3a58cfdef852 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:19.092572 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a7d01988-f227-49fd-8b3e-3a58cfdef852 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1682 microversion: 2.1 time: 0.150827 Aug 10 23:23:19.093146 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 418/827] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:18 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:20.114104 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-44fc7e48-cd1b-4520-850e-9a3ddbe16fec tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:20.114752 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-44fc7e48-cd1b-4520-850e-9a3ddbe16fec tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:20.121186 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44fc7e48-cd1b-4520-850e-9a3ddbe16fec tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.121665 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44fc7e48-cd1b-4520-850e-9a3ddbe16fec tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.122105 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44fc7e48-cd1b-4520-850e-9a3ddbe16fec tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.122840 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44fc7e48-cd1b-4520-850e-9a3ddbe16fec tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.123301 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44fc7e48-cd1b-4520-850e-9a3ddbe16fec tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.123732 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-44fc7e48-cd1b-4520-850e-9a3ddbe16fec tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.192205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-44fc7e48-cd1b-4520-850e-9a3ddbe16fec tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:20.199883 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-44fc7e48-cd1b-4520-850e-9a3ddbe16fec tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1614 microversion: 2.1 time: 0.089616 Aug 10 23:23:20.200451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 410/828] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:20 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:20.498157 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-dc16765f-21a9-4782-ab4b-dfc2346a4b1e req-6e997bea-7e10-4832-8781-8a9ebc981481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4400e6b6-97d1-400f-9a8d-2c9db7c77042", "name": "network-vif-deleted", "tag": "72395218-a18f-4a02-bea7-28b6142da97e"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:20.508844 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-dc16765f-21a9-4782-ab4b-dfc2346a4b1e req-6e997bea-7e10-4832-8781-8a9ebc981481 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.514826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-dc16765f-21a9-4782-ab4b-dfc2346a4b1e req-6e997bea-7e10-4832-8781-8a9ebc981481 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.514826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-dc16765f-21a9-4782-ab4b-dfc2346a4b1e req-6e997bea-7e10-4832-8781-8a9ebc981481 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.521091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-dc16765f-21a9-4782-ab4b-dfc2346a4b1e req-6e997bea-7e10-4832-8781-8a9ebc981481 service nova] Creating event network-vif-deleted:72395218-a18f-4a02-bea7-28b6142da97e for instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 on hv-cinder-85144 Aug 10 23:23:20.526000 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-dc16765f-21a9-4782-ab4b-dfc2346a4b1e req-6e997bea-7e10-4832-8781-8a9ebc981481 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 Aug 10 23:23:20.526714 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 419/829] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:21.226388 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:21.227059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:21.233869 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:21.234364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:21.234854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:21.235798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:21.236264 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:21.236695 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:21.270825 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:21.271320 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:21.271761 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:21.272215 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lazy-loading 'fault' on Instance uuid 4400e6b6-97d1-400f-9a8d-2c9db7c77042 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:23:21.314958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e92975af1d439f88e33cc494c88b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da31a6c1eb84fa1aaf256037c8848e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:21.322945 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-fefc2b19-ff72-4f8b-b5fe-11477de41c86 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 200 len: 1330 microversion: 2.1 time: 0.100333 Aug 10 23:23:21.323523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 411/830] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:21 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:22.345698 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:22.346392 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:22.352936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:22.353417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:22.353853 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:22.354635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:22.355112 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:22.355615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:22.369694 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 HTTP/1.1 Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:23:22.371303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:22.377184 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': '4400e6b6-97d1-400f-9a8d-2c9db7c77042'} Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:22.378165 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:22.379884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:22.381328 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:22.381328 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-85cf121a-365f-4709-a92a-f49088331dbe tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 404 len: 111 microversion: 2.1 time: 0.032192 Aug 10 23:23:22.381328 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 420/831] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:22 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:22.381804 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d242a0db-db65-4ceb-bd43-f865ee5a7184 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '.version_select at 0x7fe840528550>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:22.489052 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d242a0db-db65-4ceb-bd43-f865ee5a7184 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-796517397" status: 202 len: 0 microversion: 2.1 time: 0.110975 Aug 10 23:23:22.489641 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 412/832] 10.222.0.78 () {58 vars in 1218 bytes} [Wed Aug 10 23:23:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-796517397 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:23:24.490962 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:24.491453 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:24.497719 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:24.498196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:24.498642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:24.499334 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:24.499782 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:24.500203 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:24.513228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: DELETE /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 HTTP/1.1 Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:23:24.515386 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:24.516847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': '4400e6b6-97d1-400f-9a8d-2c9db7c77042'} Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:24.518058 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:24.519780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:24.521584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:24.521584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ce99779b-2a30-47b8-b8d6-3f4650361720 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 404 len: 111 microversion: 2.1 time: 0.029730 Aug 10 23:23:24.521584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 421/833] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:23:24 2022] DELETE /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:24.525300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:24.525917 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 4400e6b6-97d1-400f-9a8d-2c9db7c77042] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:24.533738 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:24.539696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:24.539696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:24.539696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:24.539696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:24.540078 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:24.549709 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 HTTP/1.1 Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:24.551411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:24.553087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '4400e6b6-97d1-400f-9a8d-2c9db7c77042'} Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:24.554045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. Aug 10 23:23:24.555391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:24.556632 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance 4400e6b6-97d1-400f-9a8d-2c9db7c77042 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:24.556632 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7cfbd0dd-42dd-4853-a244-de832ab935e1 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042" status: 404 len: 111 microversion: 2.1 time: 0.031397 Aug 10 23:23:24.556632 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 413/834] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:24 2022] GET /compute/v2.1/servers/4400e6b6-97d1-400f-9a8d-2c9db7c77042 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:23:25.869619 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:25.870141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:25.876669 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.877148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.877584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.878278 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.878753 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.879180 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.892808 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: DELETE /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d HTTP/1.1 Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:23:25.894363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:23:25.896048 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'b54661f9-1a04-4076-9cad-bbef28ed6e3d'} Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:25.896852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:23:25.898294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.900064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:25.900064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-dda661e3-cad5-4e6a-9986-46c3c37392ed tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 404 len: 111 microversion: 2.1 time: 0.029982 Aug 10 23:23:25.900064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 422/835] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:23:25 2022] DELETE /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:25.904059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:25.905272 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: b54661f9-1a04-4076-9cad-bbef28ed6e3d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:25.911733 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.912212 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.912779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.913691 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.913828 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.914221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.927274 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d HTTP/1.1 Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:25.928776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:23:25.930372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'b54661f9-1a04-4076-9cad-bbef28ed6e3d'} Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:25.931198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. Aug 10 23:23:25.932560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.933711 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance b54661f9-1a04-4076-9cad-bbef28ed6e3d could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:25.933711 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dc371312-9704-442a-b6d2-e1eff5107a26 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d" status: 404 len: 111 microversion: 2.1 time: 0.029895 Aug 10 23:23:25.933711 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 414/836] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:25 2022] GET /compute/v2.1/servers/b54661f9-1a04-4076-9cad-bbef28ed6e3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:25.938914 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:25.939412 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:25.945466 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.945944 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.946381 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.947107 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.947562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.947988 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.963917 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: DELETE /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 HTTP/1.1 Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:23:25.965429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:23:25.967741 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': '574d9d8d-0e53-4ef2-a3b6-098699b20113'} Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:25.968721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:23:25.970219 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:25.971986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:25.971986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-23a83665-da62-4287-bf32-726204c8f4bb tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 404 len: 111 microversion: 2.1 time: 0.031745 Aug 10 23:23:25.971986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 423/837] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:23:25 2022] DELETE /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:25.975791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:25.976408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: 574d9d8d-0e53-4ef2-a3b6-098699b20113] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:25.982301 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.982840 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.983286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.983982 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.984443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.984873 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.998220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 HTTP/1.1 Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:25.999766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:23:26.001338 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '574d9d8d-0e53-4ef2-a3b6-098699b20113'} Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:26.002174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. Aug 10 23:23:26.003769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:26.005323 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance 574d9d8d-0e53-4ef2-a3b6-098699b20113 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:26.005323 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6906f9e0-49ac-48fa-82ac-1b4320e17e4b tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113" status: 404 len: 111 microversion: 2.1 time: 0.029247 Aug 10 23:23:26.005323 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 415/838] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:25 2022] GET /compute/v2.1/servers/574d9d8d-0e53-4ef2-a3b6-098699b20113 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:27.230769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:27.231488 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:27.238376 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:27.238890 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:27.239321 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:27.240003 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:27.240447 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:27.240864 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:27.255083 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: DELETE /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d HTTP/1.1 Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:23:27.256622 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:23:27.258289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d'} Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:27.259284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:23:27.260531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.261895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:27.261895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c7669cbd-d747-425a-a9e5-ba9ae512d0d3 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 404 len: 111 microversion: 2.1 time: 0.030990 Aug 10 23:23:27.261895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 424/839] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:23:27 2022] DELETE /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:27.266467 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:27.268208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] [instance: bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:27.273624 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:27.274106 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:27.274540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:27.275266 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:27.275718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:27.276143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:27.289314 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] HTTP exception thrown: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Request method failure captured: Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d HTTP/1.1 Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9DudfvfS2j4GHdt2vll3UxlbWKF1CGmP7VbWFJDxXhvlEgnienDjLgwZJob58ewfAuQ4cXxogBB1b9DFahIEZBRXtRWl_x536I2NpwD2EJKQkBKjD4tHg43lsN091JzUsjMZ0oH9Kpfkw07v4DJI-Bs0SYmNG5EO3fY3dvlo8zkbMvw Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:27.290844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6da31a6c1eb84fa1aaf256037c8848e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6da31a6c1eb84fa1aaf256037c8848e0", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 6da31a6c1eb84fa1aaf256037c8848e0 Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1466560049 Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 22e92975af1d439f88e33cc494c88b1f Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeNegativeTest-1466560049-project Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:23:27.292540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d'} Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:27.293650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. Aug 10 23:23:27.297408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.299280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] Returning 404 to user: Instance bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:27.299280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-43cddcff-333c-421d-97c7-49ce36df3b30 tempest-AttachVolumeNegativeTest-1466560049 tempest-AttachVolumeNegativeTest-1466560049-project] 10.222.0.78 "GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d" status: 404 len: 111 microversion: 2.1 time: 0.029567 Aug 10 23:23:27.299280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 416/840] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:27 2022] GET /compute/v2.1/servers/bf3ebd4d-fc9d-42bf-9cca-833ed6b2b72d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:31.744178 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-070e1c00-125c-4124-b387-55b522f1c726 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:31.746304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-070e1c00-125c-4124-b387-55b522f1c726 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:31.752696 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-070e1c00-125c-4124-b387-55b522f1c726 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:31.753170 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-070e1c00-125c-4124-b387-55b522f1c726 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:31.753599 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-070e1c00-125c-4124-b387-55b522f1c726 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:31.754314 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-070e1c00-125c-4124-b387-55b522f1c726 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:31.754836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-070e1c00-125c-4124-b387-55b522f1c726 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:31.755201 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-070e1c00-125c-4124-b387-55b522f1c726 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:31.786822 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-070e1c00-125c-4124-b387-55b522f1c726 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046465 Aug 10 23:23:31.789666 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 425/841] 10.222.0.78 () {60 vars in 1343 bytes} [Wed Aug 10 23:23:31 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:31.855311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-650a50f9-80f9-4177-ae30-3b96b51d4360 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:31.855841 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-650a50f9-80f9-4177-ae30-3b96b51d4360 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:31.862396 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-650a50f9-80f9-4177-ae30-3b96b51d4360 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:31.862912 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-650a50f9-80f9-4177-ae30-3b96b51d4360 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:31.863352 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-650a50f9-80f9-4177-ae30-3b96b51d4360 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:31.864127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-650a50f9-80f9-4177-ae30-3b96b51d4360 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:31.864721 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-650a50f9-80f9-4177-ae30-3b96b51d4360 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:31.865148 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-650a50f9-80f9-4177-ae30-3b96b51d4360 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:31.890639 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-650a50f9-80f9-4177-ae30-3b96b51d4360 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Going to try to terminate instance {{(pid=121333) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:23:32.197600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-650a50f9-80f9-4177-ae30-3b96b51d4360 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "DELETE /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 204 len: 0 microversion: 2.20 time: 0.346106 Aug 10 23:23:32.198846 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 417/842] 10.222.0.78 () {60 vars in 1280 bytes} [Wed Aug 10 23:23:31 2022] DELETE /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:23:32.212387 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:32.212387 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:32.215337 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:32.215909 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:32.216412 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:32.217825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:32.218549 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:32.219016 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:32.517487 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:32.525385 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:32.526924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:32.528294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9fab49b7-255a-48f3-b439-d3a8ffcf2b7a tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.324892 Aug 10 23:23:32.528841 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 426/843] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:32 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:33.553539 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:33.554232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:33.560601 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:33.561111 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:33.561544 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:33.562236 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:33.562715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:33.563170 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:33.931986 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:33.939832 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:33.941354 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:33.942516 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d1c6829b-210f-423e-8c5a-97d2c2bcbe23 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1724 microversion: 2.20 time: 0.393440 Aug 10 23:23:33.943107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 418/844] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:33 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:34.750144 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-650f3326-5911-4691-93ea-2963a5769c2b tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe833cc3dc0>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:34.799168 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-650f3326-5911-4691-93ea-2963a5769c2b tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/67a59f47-8d11-4c66-b03d-12ed5e04b916" status: 200 len: 351 microversion: 2.1 time: 0.055543 Aug 10 23:23:34.799740 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 427/845] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:23:34 2022] GET /compute/v2.1/os-volumes/67a59f47-8d11-4c66-b03d-12ed5e04b916 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:34.966108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:34.967633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:34.974835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:34.975640 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:34.976277 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:34.977242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:34.977936 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:34.978428 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:35.076100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:35.077973 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-fe5525e3-1490-41f2-a825-67d625ae79c4 req-63591e21-7a78-4853-b29c-6d799c3e8cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40168342-ce20-4df4-9112-60c03c657239", "name": "network-vif-deleted", "tag": "33300b87-970b-4a82-b42e-51c6998b535a"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:35.084314 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:35.085838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45dd5b35a039468d99ec0d393056c5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830b226057d740ca85bbdde6c1a5dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:35.087286 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6764705d-37a6-45df-987d-88c3843701e1 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 200 len: 1656 microversion: 2.20 time: 0.125567 Aug 10 23:23:35.087844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 419/846] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:34 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 1656 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:35.092057 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-fe5525e3-1490-41f2-a825-67d625ae79c4 req-63591e21-7a78-4853-b29c-6d799c3e8cd8 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:35.093073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-fe5525e3-1490-41f2-a825-67d625ae79c4 req-63591e21-7a78-4853-b29c-6d799c3e8cd8 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:35.093509 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-fe5525e3-1490-41f2-a825-67d625ae79c4 req-63591e21-7a78-4853-b29c-6d799c3e8cd8 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:35.107819 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-fe5525e3-1490-41f2-a825-67d625ae79c4 req-63591e21-7a78-4853-b29c-6d799c3e8cd8 service nova] Creating event network-vif-deleted:33300b87-970b-4a82-b42e-51c6998b535a for instance 40168342-ce20-4df4-9112-60c03c657239 on hv-cinder-85144 Aug 10 23:23:35.111211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-fe5525e3-1490-41f2-a825-67d625ae79c4 req-63591e21-7a78-4853-b29c-6d799c3e8cd8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037997 Aug 10 23:23:35.111495 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 428/847] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:23:36.111638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:36.112346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:36.120725 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:36.121222 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:36.121660 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:36.122398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:36.122918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:36.123350 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:36.137864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] HTTP exception thrown: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Request method failure captured: Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 HTTP/1.1 Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9Duce-5IGmVZgqON83VaiwvoiGtAKOT-sCTaPajSQKIvCM62_1rHQ52C0hSTpZptwCu239_zyUTmXMIsfNW9pOV9hKrM_Zgr_ovZYsuFJKy6Dtq9XdrVs3BJ3BATYGbUBPW5grjJvPik3tEXRB8Ao0G0Yamf2A5FSSG3oi_YWgVaoH4 Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:36.139565 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_830b226057d740ca85bbdde6c1a5dca8", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 45dd5b35a039468d99ec0d393056c5af Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:36.141324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '40168342-ce20-4df4-9112-60c03c657239'} Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:36.142435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:36.147128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:36.148497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Returning 404 to user: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:36.148497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b51f1c57-ea02-4625-92a5-7df90f80ccc0 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 404 len: 111 microversion: 2.20 time: 0.034175 Aug 10 23:23:36.148497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 420/848] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:36 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:36.151690 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-44f681e8-de35-495e-886e-11e22a17d733 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '.version_select at 0x7fe833c483a0>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:36.266222 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-44f681e8-de35-495e-886e-11e22a17d733 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747588682" status: 204 len: 0 microversion: 2.20 time: 0.119744 Aug 10 23:23:36.266883 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 429/849] 10.222.0.78 () {60 vars in 1262 bytes} [Wed Aug 10 23:23:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747588682 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:23:36.589408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a8fdb0f9-4639-49cf-891f-e3c867a1bb1c tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe84050fc10>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:36.647008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a8fdb0f9-4639-49cf-891f-e3c867a1bb1c tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/03ca3e14-b297-413c-8d54-ed709588a1b5" status: 200 len: 349 microversion: 2.1 time: 0.051773 Aug 10 23:23:36.647008 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 421/850] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:23:36 2022] GET /compute/v2.1/os-volumes/03ca3e14-b297-413c-8d54-ed709588a1b5 => generated 349 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:23:38.353603 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5da7f60f-f8fb-456c-a4bd-b6caf05f90ca tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe833cbd820>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:38.402435 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5da7f60f-f8fb-456c-a4bd-b6caf05f90ca tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/7db6a03f-c623-45ef-8754-2980d68f621c" status: 200 len: 351 microversion: 2.1 time: 0.053259 Aug 10 23:23:38.403037 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 430/851] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:23:38 2022] GET /compute/v2.1/os-volumes/7db6a03f-c623-45ef-8754-2980d68f621c => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:38.405558 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:38.406058 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:38.408095 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:38.414051 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:38.414545 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:38.415005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:38.415708 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:38.415856 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8a299f4b-1bc5-475a-a802-f23b81e4402c tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe833d67700>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:38.416163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:38.416588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:38.420837 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:38.434087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] HTTP exception thrown: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Request method failure captured: Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: DELETE /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 HTTP/1.1 Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9Duce-5IGmVZgqON83VaiwvoiGtAKOT-sCTaPajSQKIvCM62_1rHQ52C0hSTpZptwCu239_zyUTmXMIsfNW9pOV9hKrM_Zgr_ovZYsuFJKy6Dtq9XdrVs3BJ3BATYGbUBPW5grjJvPik3tEXRB8Ao0G0Yamf2A5FSSG3oi_YWgVaoH4 Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:38.436028 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_830b226057d740ca85bbdde6c1a5dca8", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 45dd5b35a039468d99ec0d393056c5af Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:38.437866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '40168342-ce20-4df4-9112-60c03c657239'} Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:38.438854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:38.440451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:38.442068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Returning 404 to user: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:38.442068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-fb4de83d-bfa1-49ee-a07f-bb5c2e68f169 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "DELETE /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 404 len: 111 microversion: 2.20 time: 0.037382 Aug 10 23:23:38.442068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 422/852] 10.222.0.78 () {60 vars in 1280 bytes} [Wed Aug 10 23:23:38 2022] DELETE /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:38.446048 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:38.446679 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: 40168342-ce20-4df4-9112-60c03c657239] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:38.453121 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:38.453611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:38.454047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:38.454767 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:38.455225 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:38.455648 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:38.469495 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] HTTP exception thrown: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Request method failure captured: Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 HTTP/1.1 Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9Duce-5IGmVZgqON83VaiwvoiGtAKOT-sCTaPajSQKIvCM62_1rHQ52C0hSTpZptwCu239_zyUTmXMIsfNW9pOV9hKrM_Zgr_ovZYsuFJKy6Dtq9XdrVs3BJ3BATYGbUBPW5grjJvPik3tEXRB8Ao0G0Yamf2A5FSSG3oi_YWgVaoH4 Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:38.471043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_830b226057d740ca85bbdde6c1a5dca8", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 45dd5b35a039468d99ec0d393056c5af Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:38.472895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '40168342-ce20-4df4-9112-60c03c657239'} Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:38.476860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. Aug 10 23:23:38.478351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:38.479864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Returning 404 to user: Instance 40168342-ce20-4df4-9112-60c03c657239 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:38.479864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c32b582f-3619-4d70-96d5-a7b2ea0c7914 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239" status: 404 len: 111 microversion: 2.20 time: 0.029971 Aug 10 23:23:38.479864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 423/853] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:38 2022] GET /compute/v2.1/servers/40168342-ce20-4df4-9112-60c03c657239 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:38.502455 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8a299f4b-1bc5-475a-a802-f23b81e4402c tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090276 Aug 10 23:23:38.503060 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 431/854] 10.222.0.78 () {58 vars in 1134 bytes} [Wed Aug 10 23:23:38 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:38.517643 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fb0469ea-a910-4166-a073-f4d0188a4541 tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe84046cb80>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:38.598903 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-fb0469ea-a910-4166-a073-f4d0188a4541 tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085818 Aug 10 23:23:38.599473 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 424/855] 10.222.0.78 () {58 vars in 1149 bytes} [Wed Aug 10 23:23:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:38.613586 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-589b9232-c251-463c-a1eb-c82cf1ac60e2 tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe833c86430>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:38.695349 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-589b9232-c251-463c-a1eb-c82cf1ac60e2 tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086290 Aug 10 23:23:38.695933 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 432/856] 10.222.0.78 () {58 vars in 1134 bytes} [Wed Aug 10 23:23:38 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:38.710004 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-84d38829-08f4-44db-b4f3-4c66d0be5a3a tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe840414790>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:38.794674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-84d38829-08f4-44db-b4f3-4c66d0be5a3a tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.089226 Aug 10 23:23:38.795364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 425/857] 10.222.0.78 () {58 vars in 1167 bytes} [Wed Aug 10 23:23:38 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:23:38.808591 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d94b2de8-4f06-4ab7-9b8f-5b9332131aad tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe833e6e700>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:38.890382 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d94b2de8-4f06-4ab7-9b8f-5b9332131aad tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084864 Aug 10 23:23:38.891045 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 433/858] 10.222.0.78 () {58 vars in 1170 bytes} [Wed Aug 10 23:23:38 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:38.905181 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a1e72025-76f4-45d0-87bf-dfa93c6ffdb9 tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe84046c820>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:39.132605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a1e72025-76f4-45d0-87bf-dfa93c6ffdb9 tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.231535 Aug 10 23:23:39.133182 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 426/859] 10.222.0.78 () {58 vars in 1155 bytes} [Wed Aug 10 23:23:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:39.145814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-02944a8b-8f40-4bc9-8076-00cde51b89dd tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe833bd9b80>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:39.228910 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-02944a8b-8f40-4bc9-8076-00cde51b89dd tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.086700 Aug 10 23:23:39.229483 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 434/860] 10.222.0.78 () {58 vars in 1188 bytes} [Wed Aug 10 23:23:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:39.242501 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-319b9c91-6f51-4432-8f39-b0638e456eb8 tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] Calling method '.version_select at 0x7fe84050f9d0>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:39.323817 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-319b9c91-6f51-4432-8f39-b0638e456eb8 tempest-VolumesTestJSON-1842192401 tempest-VolumesTestJSON-1842192401-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084986 Aug 10 23:23:39.324391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 427/861] 10.222.0.78 () {58 vars in 1155 bytes} [Wed Aug 10 23:23:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:39.785236 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:39.785851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:39.792026 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:39.792516 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:39.792964 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:39.793660 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:39.794126 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:39.794555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:39.808312 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] HTTP exception thrown: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Request method failure captured: Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: DELETE /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 HTTP/1.1 Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9Duce-5IGmVZgqON83VaiwvoiGtAKOT-sCTaPajSQKIvCM62_1rHQ52C0hSTpZptwCu239_zyUTmXMIsfNW9pOV9hKrM_Zgr_ovZYsuFJKy6Dtq9XdrVs3BJ3BATYGbUBPW5grjJvPik3tEXRB8Ao0G0Yamf2A5FSSG3oi_YWgVaoH4 Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:23:39.809958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_830b226057d740ca85bbdde6c1a5dca8", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 45dd5b35a039468d99ec0d393056c5af Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:23:39.811755 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'd062824b-f7a6-4380-a622-5bba74816355'} Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:39.812682 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:23:39.814341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:39.815983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Returning 404 to user: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:39.815983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-10f16b95-3a8f-457f-91f0-5dd7a79ed664 tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 404 len: 111 microversion: 2.20 time: 0.030479 Aug 10 23:23:39.815983 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 435/862] 10.222.0.78 () {60 vars in 1280 bytes} [Wed Aug 10 23:23:39 2022] DELETE /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:39.820698 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:39.821324 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] [instance: d062824b-f7a6-4380-a622-5bba74816355] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:39.828041 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:39.828525 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:39.828964 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:39.829662 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:39.830121 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:39.830549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:39.844206 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] HTTP exception thrown: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Request method failure captured: Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 HTTP/1.1 Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9Duce-5IGmVZgqON83VaiwvoiGtAKOT-sCTaPajSQKIvCM62_1rHQ52C0hSTpZptwCu239_zyUTmXMIsfNW9pOV9hKrM_Zgr_ovZYsuFJKy6Dtq9XdrVs3BJ3BATYGbUBPW5grjJvPik3tEXRB8Ao0G0Yamf2A5FSSG3oi_YWgVaoH4 Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:39.845756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/830b226057d740ca85bbdde6c1a5dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_830b226057d740ca85bbdde6c1a5dca8", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 830b226057d740ca85bbdde6c1a5dca8 Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1515180908 Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 45dd5b35a039468d99ec0d393056c5af Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1515180908-project Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:23:39.853440 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'd062824b-f7a6-4380-a622-5bba74816355'} Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:39.854838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. Aug 10 23:23:39.856317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:39.857778 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] Returning 404 to user: Instance d062824b-f7a6-4380-a622-5bba74816355 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:39.857778 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-95be4ad8-814b-4f77-97d4-01d9b2cd02ea tempest-AttachVolumeShelveTestJSON-1515180908 tempest-AttachVolumeShelveTestJSON-1515180908-project] 10.222.0.78 "GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355" status: 404 len: 111 microversion: 2.20 time: 0.030998 Aug 10 23:23:39.857778 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 428/863] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:39 2022] GET /compute/v2.1/servers/d062824b-f7a6-4380-a622-5bba74816355 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:45.761610 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-79ae4c76-6bf8-4e2b-8109-7364f0f461bf tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Action: 'create', calling method: .version_select at 0x7fe833cc3dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1689069632", "metadata": {"Type": "work"}}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-79ae4c76-6bf8-4e2b-8109-7364f0f461bf tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Request method failure captured: Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 122 Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D4BrgBhJ13BDs3NfSgp2lvTzv4g0c2WZiJKYa2S-x_HkHmFq68vL6bbaS1CDwd_37vwHU5liVJaDaCdMeBI772TmHsztEubQlslX_fFs99BU1J1kcBuNmQ-ycfRVN-Cha9hEHTCiOtdtVkFc1OLHT3feknL6dcVHnnWbRO-eMEOWWI Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:23:45.776211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f3e1c4732e4943cc85c7ce3a774815b3", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 4f8d6aeeab0042e48e86fc79e4a3ba56 Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1689069632", "metadata": {"Type": "work"}}} Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: Aug 10 23:23:45.778355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1689069632', 'metadata': {'Type': 'work'}}}} Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:45.780730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:23:45.782873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:23:45.784570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 23:23:45.784570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.784570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-79ae4c76-6bf8-4e2b-8109-7364f0f461bf tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:45.784570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-79ae4c76-6bf8-4e2b-8109-7364f0f461bf tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.236977 Aug 10 23:23:45.784570 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 436/864] 10.222.0.78 () {60 vars in 1156 bytes} [Wed Aug 10 23:23:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:45.789533 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-66c4e622-dbe5-4bfc-a3ec-471c731fa849 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Action: 'create', calling method: .version_select at 0x7fe84050fe50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-184521008", "metadata": {"Type": "work"}}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-66c4e622-dbe5-4bfc-a3ec-471c731fa849 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Request method failure captured: Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 119 Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D4BrgBhJ13BDs3NfSgp2lvTzv4g0c2WZiJKYa2S-x_HkHmFq68vL6bbaS1CDwd_37vwHU5liVJaDaCdMeBI772TmHsztEubQlslX_fFs99BU1J1kcBuNmQ-ycfRVN-Cha9hEHTCiOtdtVkFc1OLHT3feknL6dcVHnnWbRO-eMEOWWI Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:45.794638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f3e1c4732e4943cc85c7ce3a774815b3", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 4f8d6aeeab0042e48e86fc79e4a3ba56 Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-184521008", "metadata": {"Type": "work"}}} Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: Aug 10 23:23:45.797653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-184521008', 'metadata': {'Type': 'work'}}}} Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi '0' Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:45.798997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:23:45.801947 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:23:45.804059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 23:23:45.804059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.804059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-66c4e622-dbe5-4bfc-a3ec-471c731fa849 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:45.804059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-66c4e622-dbe5-4bfc-a3ec-471c731fa849 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011526 Aug 10 23:23:45.804059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 429/865] 10.222.0.78 () {60 vars in 1156 bytes} [Wed Aug 10 23:23:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:45.808170 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9c639a8c-f825-48fe-b6e4-43cac87da9a0 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Action: 'create', calling method: .version_select at 0x7fe833c52550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1301752632", "metadata": {"Type": "work"}}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9c639a8c-f825-48fe-b6e4-43cac87da9a0 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Request method failure captured: Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 119 Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D4BrgBhJ13BDs3NfSgp2lvTzv4g0c2WZiJKYa2S-x_HkHmFq68vL6bbaS1CDwd_37vwHU5liVJaDaCdMeBI772TmHsztEubQlslX_fFs99BU1J1kcBuNmQ-ycfRVN-Cha9hEHTCiOtdtVkFc1OLHT3feknL6dcVHnnWbRO-eMEOWWI Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:23:45.812276 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f3e1c4732e4943cc85c7ce3a774815b3", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 4f8d6aeeab0042e48e86fc79e4a3ba56 Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1301752632", "metadata": {"Type": "work"}}} Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: Aug 10 23:23:45.813697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1301752632', 'metadata': {'Type': 'work'}}}} Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi '' Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:45.814703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:23:45.816167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:23:45.817428 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 23:23:45.817428 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.817428 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9c639a8c-f825-48fe-b6e4-43cac87da9a0 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:45.817428 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9c639a8c-f825-48fe-b6e4-43cac87da9a0 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010446 Aug 10 23:23:45.817428 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 437/866] 10.222.0.78 () {60 vars in 1156 bytes} [Wed Aug 10 23:23:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:45.824594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3544b808-f619-4e5c-86d3-be29232509dc tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Calling method '.version_select at 0x7fe84049c700>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:45.856407 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-3544b808-f619-4e5c-86d3-be29232509dc tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] HTTP exception thrown: Volume tempest-invalid-1249560179 could not be found. Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3544b808-f619-4e5c-86d3-be29232509dc tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Request method failure captured: Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1249560179 HTTP/1.1 Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D4BrgBhJ13BDs3NfSgp2lvTzv4g0c2WZiJKYa2S-x_HkHmFq68vL6bbaS1CDwd_37vwHU5liVJaDaCdMeBI772TmHsztEubQlslX_fFs99BU1J1kcBuNmQ-ycfRVN-Cha9hEHTCiOtdtVkFc1OLHT3feknL6dcVHnnWbRO-eMEOWWI Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:45.860336 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f3e1c4732e4943cc85c7ce3a774815b3", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 4f8d6aeeab0042e48e86fc79e4a3ba56 Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Volume tempest-invalid-1249560179 could not be found. Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'tempest-invalid-1249560179'} Aug 10 23:23:45.862563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1249560179 could not be found. (HTTP 404) (Request-ID: req-209cc08e-0369-4f5c-9f26-27b7eabbd203) Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.864985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:23:45.866905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1249560179 could not be found. Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:45.868579 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1249560179 could not be found. Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1249560179 could not be found. Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3544b808-f619-4e5c-86d3-be29232509dc tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Returning 404 to user: Volume tempest-invalid-1249560179 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3544b808-f619-4e5c-86d3-be29232509dc tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1249560179" status: 404 len: 99 microversion: 2.1 time: 0.041905 Aug 10 23:23:45.870357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 430/867] 10.222.0.78 () {58 vars in 1218 bytes} [Wed Aug 10 23:23:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1249560179 => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 23:23:45.874185 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-af6947b3-4213-43b7-9d4f-94f6d5c3a555 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004032 Aug 10 23:23:45.874698 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 438/868] 10.222.0.78 () {58 vars in 1140 bytes} [Wed Aug 10 23:23:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 23:23:45.883282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-bfdc2bfe-9a26-4a36-a9d9-3702d49021da tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003789 Aug 10 23:23:45.883784 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 431/869] 10.222.0.78 () {58 vars in 1137 bytes} [Wed Aug 10 23:23:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 10 23:23:45.892645 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-82d02351-20f0-47dc-8198-e00890db7810 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Calling method '.version_select at 0x7fe833bd9670>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:45.922844 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-82d02351-20f0-47dc-8198-e00890db7810 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] HTTP exception thrown: Volume f74d4c83-12b9-4abd-b557-398d40865f49 could not be found. Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-82d02351-20f0-47dc-8198-e00890db7810 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Request method failure captured: Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: DELETE /compute/v2.1/os-volumes/f74d4c83-12b9-4abd-b557-398d40865f49 HTTP/1.1 Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D4BrgBhJ13BDs3NfSgp2lvTzv4g0c2WZiJKYa2S-x_HkHmFq68vL6bbaS1CDwd_37vwHU5liVJaDaCdMeBI772TmHsztEubQlslX_fFs99BU1J1kcBuNmQ-ycfRVN-Cha9hEHTCiOtdtVkFc1OLHT3feknL6dcVHnnWbRO-eMEOWWI Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:23:45.924771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f3e1c4732e4943cc85c7ce3a774815b3", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 4f8d6aeeab0042e48e86fc79e4a3ba56 Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Volume f74d4c83-12b9-4abd-b557-398d40865f49 could not be found. Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'f74d4c83-12b9-4abd-b557-398d40865f49'} Aug 10 23:23:45.926388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f74d4c83-12b9-4abd-b557-398d40865f49 could not be found. (HTTP 404) (Request-ID: req-c81a239f-66a6-443a-b2e7-f4583fbb528d) Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.927451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:23:45.928887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f74d4c83-12b9-4abd-b557-398d40865f49 could not be found. Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 23:23:45.930131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f74d4c83-12b9-4abd-b557-398d40865f49 could not be found. Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f74d4c83-12b9-4abd-b557-398d40865f49 could not be found. Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-82d02351-20f0-47dc-8198-e00890db7810 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Returning 404 to user: Volume f74d4c83-12b9-4abd-b557-398d40865f49 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-82d02351-20f0-47dc-8198-e00890db7810 tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/f74d4c83-12b9-4abd-b557-398d40865f49" status: 404 len: 109 microversion: 2.1 time: 0.037913 Aug 10 23:23:45.931688 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 439/870] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 10 23:23:45 2022] DELETE /compute/v2.1/os-volumes/f74d4c83-12b9-4abd-b557-398d40865f49 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:45.935954 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b6ca1294-30fd-43b4-8560-8b1b5fbd053d tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Calling method '.version_select at 0x7fe84049c790>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:45.964215 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-b6ca1294-30fd-43b4-8560-8b1b5fbd053d tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] HTTP exception thrown: Volume 69ed1476-f414-468b-a9ba-7e4edc2a6466 could not be found. Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b6ca1294-30fd-43b4-8560-8b1b5fbd053d tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Request method failure captured: Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/os-volumes/69ed1476-f414-468b-a9ba-7e4edc2a6466 HTTP/1.1 Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D4BrgBhJ13BDs3NfSgp2lvTzv4g0c2WZiJKYa2S-x_HkHmFq68vL6bbaS1CDwd_37vwHU5liVJaDaCdMeBI772TmHsztEubQlslX_fFs99BU1J1kcBuNmQ-ycfRVN-Cha9hEHTCiOtdtVkFc1OLHT3feknL6dcVHnnWbRO-eMEOWWI Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:23:45.966253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f3e1c4732e4943cc85c7ce3a774815b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f3e1c4732e4943cc85c7ce3a774815b3", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: f3e1c4732e4943cc85c7ce3a774815b3 Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-VolumesNegativeTest-1735118521 Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 4f8d6aeeab0042e48e86fc79e4a3ba56 Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-VolumesNegativeTest-1735118521-project Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Volume 69ed1476-f414-468b-a9ba-7e4edc2a6466 could not be found. Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '69ed1476-f414-468b-a9ba-7e4edc2a6466'} Aug 10 23:23:45.968540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69ed1476-f414-468b-a9ba-7e4edc2a6466 could not be found. (HTTP 404) (Request-ID: req-8811cf94-e4e0-4248-aa0d-6817e89c2ccd) Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.969524 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:23:45.971085 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69ed1476-f414-468b-a9ba-7e4edc2a6466 could not be found. Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 23:23:45.972492 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69ed1476-f414-468b-a9ba-7e4edc2a6466 could not be found. Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69ed1476-f414-468b-a9ba-7e4edc2a6466 could not be found. Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b6ca1294-30fd-43b4-8560-8b1b5fbd053d tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] Returning 404 to user: Volume 69ed1476-f414-468b-a9ba-7e4edc2a6466 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b6ca1294-30fd-43b4-8560-8b1b5fbd053d tempest-VolumesNegativeTest-1735118521 tempest-VolumesNegativeTest-1735118521-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/69ed1476-f414-468b-a9ba-7e4edc2a6466" status: 404 len: 109 microversion: 2.1 time: 0.037572 Aug 10 23:23:45.974488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 432/871] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:23:45 2022] GET /compute/v2.1/os-volumes/69ed1476-f414-468b-a9ba-7e4edc2a6466 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:47.207249 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d17d9d66-2623-4870-a4f0-3e3684517da3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:47.207813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d17d9d66-2623-4870-a4f0-3e3684517da3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:47.209788 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:47.214775 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17d9d66-2623-4870-a4f0-3e3684517da3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:47.215265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17d9d66-2623-4870-a4f0-3e3684517da3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:47.216164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17d9d66-2623-4870-a4f0-3e3684517da3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:47.216512 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17d9d66-2623-4870-a4f0-3e3684517da3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:47.216975 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17d9d66-2623-4870-a4f0-3e3684517da3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:47.217409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d17d9d66-2623-4870-a4f0-3e3684517da3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:47.221366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:47.322446 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-d17d9d66-2623-4870-a4f0-3e3684517da3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lazy-loading 'services' on Instance uuid d6ed0bfa-e1e6-429e-b615-567dbbc217a9 {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:23:47.571008 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d17d9d66-2623-4870-a4f0-3e3684517da3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/os-volume_attachments/f04bfdc5-2051-4398-a3c6-a4b0157146fc" status: 202 len: 0 microversion: 2.1 time: 0.369400 Aug 10 23:23:47.571606 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 440/872] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:23:47 2022] DELETE /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/os-volume_attachments/f04bfdc5-2051-4398-a3c6-a4b0157146fc => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:23:48.703712 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-668d83e2-c2bf-4c34-af9b-d99108ceb40f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:48.712895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-668d83e2-c2bf-4c34-af9b-d99108ceb40f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:48.713339 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-668d83e2-c2bf-4c34-af9b-d99108ceb40f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:48.713780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-668d83e2-c2bf-4c34-af9b-d99108ceb40f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:48.736021 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-668d83e2-c2bf-4c34-af9b-d99108ceb40f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Going to try to stop instance {{(pid=121333) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:23:48.970588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-668d83e2-c2bf-4c34-af9b-d99108ceb40f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/action" status: 202 len: 0 microversion: 2.1 time: 0.272605 Aug 10 23:23:48.971225 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 433/873] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:23:48 2022] POST /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:23:48.981076 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-63ed21a6-42cd-45ea-90f8-3956bd93056d tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:48.981798 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-63ed21a6-42cd-45ea-90f8-3956bd93056d tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:48.991936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-63ed21a6-42cd-45ea-90f8-3956bd93056d tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:48.992419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-63ed21a6-42cd-45ea-90f8-3956bd93056d tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:48.992852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-63ed21a6-42cd-45ea-90f8-3956bd93056d tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:48.993559 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-63ed21a6-42cd-45ea-90f8-3956bd93056d tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:48.994007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-63ed21a6-42cd-45ea-90f8-3956bd93056d tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:48.994427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-63ed21a6-42cd-45ea-90f8-3956bd93056d tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:49.167515 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-63ed21a6-42cd-45ea-90f8-3956bd93056d tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:49.178584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-63ed21a6-42cd-45ea-90f8-3956bd93056d tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1675 microversion: 2.1 time: 0.202459 Aug 10 23:23:49.182921 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 441/874] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:48 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:50.206771 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7e8a3909-6a1b-455c-a9a1-2e9a1574dc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:50.207611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7e8a3909-6a1b-455c-a9a1-2e9a1574dc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:50.215232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8a3909-6a1b-455c-a9a1-2e9a1574dc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:50.215769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8a3909-6a1b-455c-a9a1-2e9a1574dc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:50.218860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8a3909-6a1b-455c-a9a1-2e9a1574dc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:50.218860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8a3909-6a1b-455c-a9a1-2e9a1574dc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:50.218860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8a3909-6a1b-455c-a9a1-2e9a1574dc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:50.218860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8a3909-6a1b-455c-a9a1-2e9a1574dc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:50.351525 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7e8a3909-6a1b-455c-a9a1-2e9a1574dc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:50.359665 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7e8a3909-6a1b-455c-a9a1-2e9a1574dc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1675 microversion: 2.1 time: 0.160457 Aug 10 23:23:50.360249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 434/875] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:50 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:51.380903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6b877363-dee7-4a88-9c9c-2a48bed155ec tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:51.381520 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6b877363-dee7-4a88-9c9c-2a48bed155ec tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:51.388459 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b877363-dee7-4a88-9c9c-2a48bed155ec tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:51.388942 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b877363-dee7-4a88-9c9c-2a48bed155ec tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:51.389378 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b877363-dee7-4a88-9c9c-2a48bed155ec tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:51.390101 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b877363-dee7-4a88-9c9c-2a48bed155ec tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:51.390557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b877363-dee7-4a88-9c9c-2a48bed155ec tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:51.391016 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6b877363-dee7-4a88-9c9c-2a48bed155ec tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:51.523965 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6b877363-dee7-4a88-9c9c-2a48bed155ec tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:51.532016 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6b877363-dee7-4a88-9c9c-2a48bed155ec tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1675 microversion: 2.1 time: 0.154911 Aug 10 23:23:51.532583 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 442/876] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:51 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:52.553296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e925b352-b169-4514-836e-69d80cf9c132 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:52.553914 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e925b352-b169-4514-836e-69d80cf9c132 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:52.560443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e925b352-b169-4514-836e-69d80cf9c132 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:52.560930 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e925b352-b169-4514-836e-69d80cf9c132 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:52.561416 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e925b352-b169-4514-836e-69d80cf9c132 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:52.562608 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e925b352-b169-4514-836e-69d80cf9c132 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:52.563101 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e925b352-b169-4514-836e-69d80cf9c132 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:52.563529 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e925b352-b169-4514-836e-69d80cf9c132 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:52.690348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e925b352-b169-4514-836e-69d80cf9c132 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:52.697883 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e925b352-b169-4514-836e-69d80cf9c132 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1675 microversion: 2.1 time: 0.148423 Aug 10 23:23:52.698443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 435/877] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:52 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:53.719413 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f2c31982-599e-4114-91ec-d107b22254b3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:53.719936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f2c31982-599e-4114-91ec-d107b22254b3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:53.726388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f2c31982-599e-4114-91ec-d107b22254b3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:53.726913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f2c31982-599e-4114-91ec-d107b22254b3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:53.727351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f2c31982-599e-4114-91ec-d107b22254b3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:53.728043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f2c31982-599e-4114-91ec-d107b22254b3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:53.728496 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f2c31982-599e-4114-91ec-d107b22254b3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:53.728922 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f2c31982-599e-4114-91ec-d107b22254b3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:53.872724 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f2c31982-599e-4114-91ec-d107b22254b3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:53.882206 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f2c31982-599e-4114-91ec-d107b22254b3 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1675 microversion: 2.1 time: 0.167278 Aug 10 23:23:53.882810 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 443/878] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:53 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:54.903628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-421bc01a-47da-44d9-ad64-d8bb0bc49e53 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:54.904285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-421bc01a-47da-44d9-ad64-d8bb0bc49e53 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:54.911410 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-421bc01a-47da-44d9-ad64-d8bb0bc49e53 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:54.911898 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-421bc01a-47da-44d9-ad64-d8bb0bc49e53 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:54.912339 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-421bc01a-47da-44d9-ad64-d8bb0bc49e53 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:54.913041 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-421bc01a-47da-44d9-ad64-d8bb0bc49e53 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:54.913504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-421bc01a-47da-44d9-ad64-d8bb0bc49e53 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:54.913935 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-421bc01a-47da-44d9-ad64-d8bb0bc49e53 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:55.038897 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-421bc01a-47da-44d9-ad64-d8bb0bc49e53 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:55.046261 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-421bc01a-47da-44d9-ad64-d8bb0bc49e53 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1675 microversion: 2.1 time: 0.146453 Aug 10 23:23:55.046855 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 436/879] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:54 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:56.067390 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-713d0cea-edaa-41b3-9712-6c8c143cda94 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:56.068049 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-713d0cea-edaa-41b3-9712-6c8c143cda94 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:56.074407 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-713d0cea-edaa-41b3-9712-6c8c143cda94 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:56.074911 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-713d0cea-edaa-41b3-9712-6c8c143cda94 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:56.075343 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-713d0cea-edaa-41b3-9712-6c8c143cda94 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:56.076035 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-713d0cea-edaa-41b3-9712-6c8c143cda94 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:56.076480 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-713d0cea-edaa-41b3-9712-6c8c143cda94 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:56.076900 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-713d0cea-edaa-41b3-9712-6c8c143cda94 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:56.212097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-713d0cea-edaa-41b3-9712-6c8c143cda94 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:56.220094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-713d0cea-edaa-41b3-9712-6c8c143cda94 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1675 microversion: 2.1 time: 0.156647 Aug 10 23:23:56.220670 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 444/880] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:56 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:57.240849 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ed86ec0d-7a9a-4e0e-b5e7-7d6b7576c89b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:57.241460 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-ed86ec0d-7a9a-4e0e-b5e7-7d6b7576c89b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:57.247917 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed86ec0d-7a9a-4e0e-b5e7-7d6b7576c89b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:57.248401 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed86ec0d-7a9a-4e0e-b5e7-7d6b7576c89b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:57.248902 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed86ec0d-7a9a-4e0e-b5e7-7d6b7576c89b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:57.249625 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed86ec0d-7a9a-4e0e-b5e7-7d6b7576c89b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:57.250061 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed86ec0d-7a9a-4e0e-b5e7-7d6b7576c89b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:57.250489 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-ed86ec0d-7a9a-4e0e-b5e7-7d6b7576c89b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:57.390108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-ed86ec0d-7a9a-4e0e-b5e7-7d6b7576c89b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:57.397639 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ed86ec0d-7a9a-4e0e-b5e7-7d6b7576c89b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1675 microversion: 2.1 time: 0.160740 Aug 10 23:23:57.398196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 437/881] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:57 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:58.423927 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e30ec075-1b19-45bf-9f01-8ceba4652fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:58.424550 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e30ec075-1b19-45bf-9f01-8ceba4652fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:58.432587 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e30ec075-1b19-45bf-9f01-8ceba4652fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:58.433080 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e30ec075-1b19-45bf-9f01-8ceba4652fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:58.433524 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e30ec075-1b19-45bf-9f01-8ceba4652fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:58.434230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e30ec075-1b19-45bf-9f01-8ceba4652fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:58.434714 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e30ec075-1b19-45bf-9f01-8ceba4652fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:58.435146 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e30ec075-1b19-45bf-9f01-8ceba4652fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:58.566767 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e30ec075-1b19-45bf-9f01-8ceba4652fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:58.574027 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e30ec075-1b19-45bf-9f01-8ceba4652fc6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1675 microversion: 2.1 time: 0.154664 Aug 10 23:23:58.574585 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 445/882] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:58 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:59.595798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1c5eddb1-a95a-45ee-abc9-228a4adfcb24 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:59.596465 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1c5eddb1-a95a-45ee-abc9-228a4adfcb24 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:59.606306 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c5eddb1-a95a-45ee-abc9-228a4adfcb24 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:59.607035 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c5eddb1-a95a-45ee-abc9-228a4adfcb24 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:59.607687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c5eddb1-a95a-45ee-abc9-228a4adfcb24 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:59.608924 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c5eddb1-a95a-45ee-abc9-228a4adfcb24 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:59.609384 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c5eddb1-a95a-45ee-abc9-228a4adfcb24 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:59.609813 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1c5eddb1-a95a-45ee-abc9-228a4adfcb24 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:59.749509 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1c5eddb1-a95a-45ee-abc9-228a4adfcb24 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:59.757490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1c5eddb1-a95a-45ee-abc9-228a4adfcb24 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1652 microversion: 2.1 time: 0.165743 Aug 10 23:23:59.758285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 438/883] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:59 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1652 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:59.778252 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-633d1195-6558-4d10-84dd-2827f150e2a7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:59.785087 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-633d1195-6558-4d10-84dd-2827f150e2a7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:59.785581 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-633d1195-6558-4d10-84dd-2827f150e2a7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:59.786059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-633d1195-6558-4d10-84dd-2827f150e2a7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:59.807909 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-633d1195-6558-4d10-84dd-2827f150e2a7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Going to try to start instance {{(pid=121332) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 23:24:00.062948 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-633d1195-6558-4d10-84dd-2827f150e2a7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/action" status: 202 len: 0 microversion: 2.1 time: 0.288259 Aug 10 23:24:00.063547 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 446/884] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:23:59 2022] POST /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:24:00.071619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9bbbc05a-0405-46cf-955e-2195335de6a9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:00.072233 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9bbbc05a-0405-46cf-955e-2195335de6a9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:00.079525 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9bbbc05a-0405-46cf-955e-2195335de6a9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:00.080011 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9bbbc05a-0405-46cf-955e-2195335de6a9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:00.080435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9bbbc05a-0405-46cf-955e-2195335de6a9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:00.081136 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9bbbc05a-0405-46cf-955e-2195335de6a9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:00.081589 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9bbbc05a-0405-46cf-955e-2195335de6a9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:00.082010 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9bbbc05a-0405-46cf-955e-2195335de6a9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:00.216644 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9bbbc05a-0405-46cf-955e-2195335de6a9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:00.224169 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9bbbc05a-0405-46cf-955e-2195335de6a9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1661 microversion: 2.1 time: 0.156384 Aug 10 23:24:00.224737 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 439/885] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:00 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:01.247897 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-10de0e18-7b17-4752-aab3-0c431d473a50 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:01.248611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-10de0e18-7b17-4752-aab3-0c431d473a50 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:01.256504 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10de0e18-7b17-4752-aab3-0c431d473a50 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:01.257233 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10de0e18-7b17-4752-aab3-0c431d473a50 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:01.257674 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10de0e18-7b17-4752-aab3-0c431d473a50 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:01.258393 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10de0e18-7b17-4752-aab3-0c431d473a50 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:01.258888 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10de0e18-7b17-4752-aab3-0c431d473a50 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:01.259346 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-10de0e18-7b17-4752-aab3-0c431d473a50 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:01.558903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-10de0e18-7b17-4752-aab3-0c431d473a50 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:01.566402 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-10de0e18-7b17-4752-aab3-0c431d473a50 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1661 microversion: 2.1 time: 0.324284 Aug 10 23:24:01.567024 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 447/886] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:01 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1661 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:02.588161 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-cef50065-bb35-4652-a60a-0335b825346f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:02.588905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-cef50065-bb35-4652-a60a-0335b825346f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:02.595889 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cef50065-bb35-4652-a60a-0335b825346f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:02.596379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cef50065-bb35-4652-a60a-0335b825346f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:02.596816 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cef50065-bb35-4652-a60a-0335b825346f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:02.597559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cef50065-bb35-4652-a60a-0335b825346f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:02.597974 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cef50065-bb35-4652-a60a-0335b825346f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:02.598401 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cef50065-bb35-4652-a60a-0335b825346f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:02.732358 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cef50065-bb35-4652-a60a-0335b825346f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:02.739977 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-cef50065-bb35-4652-a60a-0335b825346f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1665 microversion: 2.1 time: 0.156001 Aug 10 23:24:02.740541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 440/887] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:02 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:14.466062 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-65a776a5-03b6-41c1-bc9c-c63cb23174bb req-85a74ca8-8ae0-4eb2-b985-42b69b26131c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace5e95d-7b24-4111-ae18-7185b8662c79", "tag": "cd7e7501-d9b2-4b2f-9318-8204c144c269"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:24:14.467011 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6c83a247-81ab-4887-8a10-e014b3f22da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:14.468083 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6c83a247-81ab-4887-8a10-e014b3f22da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:14.470425 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=15 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:14.471118 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:14.475879 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=21 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:14.476701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:14.477438 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6c83a247-81ab-4887-8a10-e014b3f22da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:14.477837 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6c83a247-81ab-4887-8a10-e014b3f22da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:14.478267 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6c83a247-81ab-4887-8a10-e014b3f22da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:14.479049 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6c83a247-81ab-4887-8a10-e014b3f22da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:14.479531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6c83a247-81ab-4887-8a10-e014b3f22da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:14.480123 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6c83a247-81ab-4887-8a10-e014b3f22da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:14.482013 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-65a776a5-03b6-41c1-bc9c-c63cb23174bb req-85a74ca8-8ae0-4eb2-b985-42b69b26131c service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:14.485199 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-65a776a5-03b6-41c1-bc9c-c63cb23174bb req-85a74ca8-8ae0-4eb2-b985-42b69b26131c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:14.485199 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-65a776a5-03b6-41c1-bc9c-c63cb23174bb req-85a74ca8-8ae0-4eb2-b985-42b69b26131c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:14.495939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-65a776a5-03b6-41c1-bc9c-c63cb23174bb req-85a74ca8-8ae0-4eb2-b985-42b69b26131c service nova] Creating event network-changed:cd7e7501-d9b2-4b2f-9318-8204c144c269 for instance ace5e95d-7b24-4111-ae18-7185b8662c79 on hv-cinder-85144 Aug 10 23:24:14.501241 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-65a776a5-03b6-41c1-bc9c-c63cb23174bb req-85a74ca8-8ae0-4eb2-b985-42b69b26131c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038884 Aug 10 23:24:14.502016 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 441/888] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:24:14.507043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6c83a247-81ab-4887-8a10-e014b3f22da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:24:14.848442 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6c83a247-81ab-4887-8a10-e014b3f22da3 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 204 len: 0 microversion: 2.1 time: 0.391072 Aug 10 23:24:14.849149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 448/889] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:24:14 2022] DELETE /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:24:14.858595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1873fa94-ac7d-4950-a476-5757466a36ce tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:14.859430 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1873fa94-ac7d-4950-a476-5757466a36ce tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:14.866672 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1873fa94-ac7d-4950-a476-5757466a36ce tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:14.867198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1873fa94-ac7d-4950-a476-5757466a36ce tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:14.867650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1873fa94-ac7d-4950-a476-5757466a36ce tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:14.868348 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1873fa94-ac7d-4950-a476-5757466a36ce tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:14.868808 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1873fa94-ac7d-4950-a476-5757466a36ce tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:14.869236 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1873fa94-ac7d-4950-a476-5757466a36ce tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:15.005112 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1873fa94-ac7d-4950-a476-5757466a36ce tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:15.012626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1873fa94-ac7d-4950-a476-5757466a36ce tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.159052 Aug 10 23:24:15.013196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 442/890] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:14 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:16.035061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-968e5848-cdaa-4785-aa9c-e18f4c62bc8a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:16.035791 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-968e5848-cdaa-4785-aa9c-e18f4c62bc8a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:16.042859 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-968e5848-cdaa-4785-aa9c-e18f4c62bc8a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:16.043402 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-968e5848-cdaa-4785-aa9c-e18f4c62bc8a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:16.043838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-968e5848-cdaa-4785-aa9c-e18f4c62bc8a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:16.044536 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-968e5848-cdaa-4785-aa9c-e18f4c62bc8a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:16.044991 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-968e5848-cdaa-4785-aa9c-e18f4c62bc8a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:16.045415 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-968e5848-cdaa-4785-aa9c-e18f4c62bc8a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:16.179390 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-968e5848-cdaa-4785-aa9c-e18f4c62bc8a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:16.186941 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-968e5848-cdaa-4785-aa9c-e18f4c62bc8a tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.156853 Aug 10 23:24:16.187503 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 449/891] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:16 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:17.209195 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1d91034f-6fc4-49bb-aa37-9d869d785aa2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:17.209775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1d91034f-6fc4-49bb-aa37-9d869d785aa2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:17.216858 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1d91034f-6fc4-49bb-aa37-9d869d785aa2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:17.217347 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1d91034f-6fc4-49bb-aa37-9d869d785aa2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:17.217789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1d91034f-6fc4-49bb-aa37-9d869d785aa2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:17.218497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1d91034f-6fc4-49bb-aa37-9d869d785aa2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:17.219509 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1d91034f-6fc4-49bb-aa37-9d869d785aa2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:17.219951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1d91034f-6fc4-49bb-aa37-9d869d785aa2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:17.391889 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1d91034f-6fc4-49bb-aa37-9d869d785aa2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:17.399535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1d91034f-6fc4-49bb-aa37-9d869d785aa2 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1567 microversion: 2.1 time: 0.194678 Aug 10 23:24:17.400115 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 443/892] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:17 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:18.423300 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3ba42e5f-3b24-485a-97ce-9fe222eb7083 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:18.424002 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3ba42e5f-3b24-485a-97ce-9fe222eb7083 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:18.430872 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3ba42e5f-3b24-485a-97ce-9fe222eb7083 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:18.431440 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3ba42e5f-3b24-485a-97ce-9fe222eb7083 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:18.431982 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3ba42e5f-3b24-485a-97ce-9fe222eb7083 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:18.432781 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3ba42e5f-3b24-485a-97ce-9fe222eb7083 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:18.433317 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3ba42e5f-3b24-485a-97ce-9fe222eb7083 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:18.433816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3ba42e5f-3b24-485a-97ce-9fe222eb7083 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:18.657125 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3ba42e5f-3b24-485a-97ce-9fe222eb7083 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:18.665365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3ba42e5f-3b24-485a-97ce-9fe222eb7083 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1448 microversion: 2.1 time: 0.246572 Aug 10 23:24:18.665947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 450/893] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:18 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1448 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:18.785684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-8298ddaa-92de-4628-a261-dee3f64f9e4b req-25583d45-8cb0-43ee-8525-dc73621f1493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace5e95d-7b24-4111-ae18-7185b8662c79", "name": "network-vif-deleted", "tag": "cd7e7501-d9b2-4b2f-9318-8204c144c269"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:24:18.796959 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-8298ddaa-92de-4628-a261-dee3f64f9e4b req-25583d45-8cb0-43ee-8525-dc73621f1493 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:18.798203 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-8298ddaa-92de-4628-a261-dee3f64f9e4b req-25583d45-8cb0-43ee-8525-dc73621f1493 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:18.798642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-8298ddaa-92de-4628-a261-dee3f64f9e4b req-25583d45-8cb0-43ee-8525-dc73621f1493 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:18.811311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-8298ddaa-92de-4628-a261-dee3f64f9e4b req-25583d45-8cb0-43ee-8525-dc73621f1493 service nova] Creating event network-vif-deleted:cd7e7501-d9b2-4b2f-9318-8204c144c269 for instance ace5e95d-7b24-4111-ae18-7185b8662c79 on hv-cinder-85144 Aug 10 23:24:18.816562 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-8298ddaa-92de-4628-a261-dee3f64f9e4b req-25583d45-8cb0-43ee-8525-dc73621f1493 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170834 Aug 10 23:24:18.817164 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 444/894] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:24:19.688192 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-de276000-b155-446c-ad84-15ae06ec6e39 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:19.688814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-de276000-b155-446c-ad84-15ae06ec6e39 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:19.695928 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-de276000-b155-446c-ad84-15ae06ec6e39 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:19.696381 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-de276000-b155-446c-ad84-15ae06ec6e39 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:19.696823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-de276000-b155-446c-ad84-15ae06ec6e39 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:19.697500 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-de276000-b155-446c-ad84-15ae06ec6e39 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:19.697980 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-de276000-b155-446c-ad84-15ae06ec6e39 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:19.698465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-de276000-b155-446c-ad84-15ae06ec6e39 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:19.764825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-de276000-b155-446c-ad84-15ae06ec6e39 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:19.772998 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-de276000-b155-446c-ad84-15ae06ec6e39 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1219 microversion: 2.1 time: 0.088675 Aug 10 23:24:19.773565 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 451/895] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:19 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:20.794918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:20.795622 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:20.803071 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:20.803551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:20.803997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:20.804702 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:20.805156 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:20.805584 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:20.839702 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:20.840147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:20.840708 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:20.841190 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lazy-loading 'fault' on Instance uuid ace5e95d-7b24-4111-ae18-7185b8662c79 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:24:20.888481 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a56142f0fc4c32b7e34ec74803407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e855cc11f6a142f9a6d31088812beeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:20.895466 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b8fee637-6914-4d02-92f6-22a55591c2ca tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 200 len: 1178 microversion: 2.1 time: 0.104775 Aug 10 23:24:20.896174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 445/896] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:20 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 1178 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:21.918993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:21.918993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] [instance: ace5e95d-7b24-4111-ae18-7185b8662c79] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:21.924666 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:21.925234 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:21.925743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:21.926544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:21.927194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:21.927719 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:21.941987 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] HTTP exception thrown: Instance ace5e95d-7b24-4111-ae18-7185b8662c79 could not be found. Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Request method failure captured: Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 HTTP/1.1 Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9DzB8lUI7C3zptKZjq_ZMxEaIRf8kpkZ420S-1L7S_aJuU2UrYXnHLoCQZCqzXgsVdvcbaYbXtCmaMxj3tCun2TLAN_U0v6IPaF0hix_FgAtAbLhXYxLgMAMoMzpjsfYxE-mpgeDDpVlX-aruERvxqX4TtZZR6g_oXkdtmXtYoqi_Qs Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: e855cc11f6a142f9a6d31088812beeef Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-TestShelveInstance-1271467160 Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:24:21.945409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e855cc11f6a142f9a6d31088812beeef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e855cc11f6a142f9a6d31088812beeef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e855cc11f6a142f9a6d31088812beeef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e855cc11f6a142f9a6d31088812beeef", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-TestShelveInstance-1271467160 Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: e855cc11f6a142f9a6d31088812beeef Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-TestShelveInstance-1271467160 Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-TestShelveInstance-1271467160-project Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: d0a56142f0fc4c32b7e34ec74803407f Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-TestShelveInstance-1271467160-project Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance ace5e95d-7b24-4111-ae18-7185b8662c79 could not be found. Aug 10 23:24:21.947253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'ace5e95d-7b24-4111-ae18-7185b8662c79'} Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace5e95d-7b24-4111-ae18-7185b8662c79 could not be found. Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:24:21.948279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace5e95d-7b24-4111-ae18-7185b8662c79 could not be found. Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace5e95d-7b24-4111-ae18-7185b8662c79 could not be found. Aug 10 23:24:21.949913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:24:21.952082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Returning 404 to user: Instance ace5e95d-7b24-4111-ae18-7185b8662c79 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:24:21.952082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1a648126-0ccf-40f4-9cea-055c90ac823e tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79" status: 404 len: 111 microversion: 2.1 time: 0.032313 Aug 10 23:24:21.952082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 452/897] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:21 2022] GET /compute/v2.1/servers/ace5e95d-7b24-4111-ae18-7185b8662c79 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:24:22.207588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-72493a34-959c-438c-a123-8f47c2329230 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] Calling method '.version_select at 0x7fe8403ef1f0>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:22.326878 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-72493a34-959c-438c-a123-8f47c2329230 tempest-TestShelveInstance-1271467160 tempest-TestShelveInstance-1271467160-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1536175681" status: 202 len: 0 microversion: 2.1 time: 0.123957 Aug 10 23:24:22.327670 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 446/898] 10.222.0.78 () {58 vars in 1254 bytes} [Wed Aug 10 23:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1536175681 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:25:03.419444 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:03.420964 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:03.607489 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a00074ea-0b37-4061-918c-e1adaaea59bb tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Action: 'create', calling method: .version_select at 0x7fe833d84ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1887301686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdvq8FqQ7yZJp/lgAaPr0+FgwrTCwngSPFe0pvURLboJh0bVKKdPbGn70lGjOpU0fWMtyCI4bLOPBYP61KQ5XnL0IVR4kiEKn2R8wB7iczNI+LEi7PEdoqGh77nRUFTAA=="}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:03.623840 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-a00074ea-0b37-4061-918c-e1adaaea59bb tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Getting quotas for project 8d2bfa865669477f8757e977da29420a. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:25:03.628287 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-a00074ea-0b37-4061-918c-e1adaaea59bb tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Getting quotas for user 05e18a4fd73e435aa6d0f10a37405698 and project 8d2bfa865669477f8757e977da29420a. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:25:03.776213 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a00074ea-0b37-4061-918c-e1adaaea59bb tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.353740 Aug 10 23:25:03.776213 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 453/899] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 10 23:25:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:14.349719 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e611fd75-fcbe-4409-a8d0-29dc6d3a620a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:14.351833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e611fd75-fcbe-4409-a8d0-29dc6d3a620a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:14.353975 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=24 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:14.354792 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:14.360785 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e611fd75-fcbe-4409-a8d0-29dc6d3a620a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:14.368850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e611fd75-fcbe-4409-a8d0-29dc6d3a620a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:14.368850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e611fd75-fcbe-4409-a8d0-29dc6d3a620a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:14.368850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e611fd75-fcbe-4409-a8d0-29dc6d3a620a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:14.368850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e611fd75-fcbe-4409-a8d0-29dc6d3a620a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:14.369273 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e611fd75-fcbe-4409-a8d0-29dc6d3a620a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:14.400194 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e611fd75-fcbe-4409-a8d0-29dc6d3a620a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054478 Aug 10 23:25:14.400665 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 447/900] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:25:14 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:25:14.460883 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=4 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:14.466299 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c1dbd90a-7be7-4fde-8ed7-607750b0ca37 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:14.466846 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c1dbd90a-7be7-4fde-8ed7-607750b0ca37 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:14.474437 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1dbd90a-7be7-4fde-8ed7-607750b0ca37 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:14.474963 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1dbd90a-7be7-4fde-8ed7-607750b0ca37 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:14.475474 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1dbd90a-7be7-4fde-8ed7-607750b0ca37 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:14.476173 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1dbd90a-7be7-4fde-8ed7-607750b0ca37 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:14.476635 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1dbd90a-7be7-4fde-8ed7-607750b0ca37 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:14.477069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1dbd90a-7be7-4fde-8ed7-607750b0ca37 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:14.504531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c1dbd90a-7be7-4fde-8ed7-607750b0ca37 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:25:14.922248 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c1dbd90a-7be7-4fde-8ed7-607750b0ca37 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 204 len: 0 microversion: 2.1 time: 0.462672 Aug 10 23:25:14.922876 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 454/901] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:25:14 2022] DELETE /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:25:14.937868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3221a107-e5b5-48d8-956f-b307c338cba1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:14.938398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3221a107-e5b5-48d8-956f-b307c338cba1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:14.945828 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3221a107-e5b5-48d8-956f-b307c338cba1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:14.946312 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3221a107-e5b5-48d8-956f-b307c338cba1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:14.946763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3221a107-e5b5-48d8-956f-b307c338cba1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:14.947473 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3221a107-e5b5-48d8-956f-b307c338cba1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:14.947920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3221a107-e5b5-48d8-956f-b307c338cba1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:14.948344 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3221a107-e5b5-48d8-956f-b307c338cba1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:15.094188 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3221a107-e5b5-48d8-956f-b307c338cba1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:15.106203 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3221a107-e5b5-48d8-956f-b307c338cba1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1671 microversion: 2.1 time: 0.172959 Aug 10 23:25:15.107325 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 448/902] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:14 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:16.027844 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:25:16.028383 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Wed Aug 10 23:25:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:25:16.131893 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5e721721-5ecd-4edd-a68d-7ffce0b549c7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:16.131893 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5e721721-5ecd-4edd-a68d-7ffce0b549c7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:16.137427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e721721-5ecd-4edd-a68d-7ffce0b549c7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:16.137922 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e721721-5ecd-4edd-a68d-7ffce0b549c7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:16.138365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e721721-5ecd-4edd-a68d-7ffce0b549c7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:16.139115 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e721721-5ecd-4edd-a68d-7ffce0b549c7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:16.139576 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e721721-5ecd-4edd-a68d-7ffce0b549c7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:16.140007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5e721721-5ecd-4edd-a68d-7ffce0b549c7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:16.272335 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5e721721-5ecd-4edd-a68d-7ffce0b549c7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:16.280055 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5e721721-5ecd-4edd-a68d-7ffce0b549c7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1671 microversion: 2.1 time: 0.154338 Aug 10 23:25:16.280630 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 455/903] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:16 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:17.303088 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5394dafb-9f3f-4ae8-bf55-50683ef3761c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:17.303911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5394dafb-9f3f-4ae8-bf55-50683ef3761c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:17.309851 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5394dafb-9f3f-4ae8-bf55-50683ef3761c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:17.310323 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5394dafb-9f3f-4ae8-bf55-50683ef3761c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:17.310814 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5394dafb-9f3f-4ae8-bf55-50683ef3761c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:17.311501 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5394dafb-9f3f-4ae8-bf55-50683ef3761c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:17.311951 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5394dafb-9f3f-4ae8-bf55-50683ef3761c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:17.312372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5394dafb-9f3f-4ae8-bf55-50683ef3761c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:17.693568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5394dafb-9f3f-4ae8-bf55-50683ef3761c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:17.701203 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5394dafb-9f3f-4ae8-bf55-50683ef3761c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1671 microversion: 2.1 time: 0.402994 Aug 10 23:25:17.701781 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 449/904] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:17 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1671 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:18.724530 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7e7ded1b-8643-4e0e-bf89-7a3bea1536d6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:18.726040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7e7ded1b-8643-4e0e-bf89-7a3bea1536d6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:18.733430 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e7ded1b-8643-4e0e-bf89-7a3bea1536d6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:18.733919 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e7ded1b-8643-4e0e-bf89-7a3bea1536d6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:18.734554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e7ded1b-8643-4e0e-bf89-7a3bea1536d6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:18.735304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e7ded1b-8643-4e0e-bf89-7a3bea1536d6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:18.735791 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e7ded1b-8643-4e0e-bf89-7a3bea1536d6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:18.736223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e7ded1b-8643-4e0e-bf89-7a3bea1536d6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:18.767040 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-c2eae75e-d555-4b19-bc51-7dedc5f5a69b req-59be0733-70f5-43d9-a191-d1810f0dbf8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ed0bfa-e1e6-429e-b615-567dbbc217a9", "name": "network-vif-deleted", "tag": "cfb5a114-7f09-4646-a431-86f19b7d5378"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:18.777182 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-c2eae75e-d555-4b19-bc51-7dedc5f5a69b req-59be0733-70f5-43d9-a191-d1810f0dbf8d service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:18.777673 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-c2eae75e-d555-4b19-bc51-7dedc5f5a69b req-59be0733-70f5-43d9-a191-d1810f0dbf8d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:18.778106 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-c2eae75e-d555-4b19-bc51-7dedc5f5a69b req-59be0733-70f5-43d9-a191-d1810f0dbf8d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:18.790712 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-c2eae75e-d555-4b19-bc51-7dedc5f5a69b req-59be0733-70f5-43d9-a191-d1810f0dbf8d service nova] Creating event network-vif-deleted:cfb5a114-7f09-4646-a431-86f19b7d5378 for instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 on hv-cinder-85144 Aug 10 23:25:18.796793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-c2eae75e-d555-4b19-bc51-7dedc5f5a69b req-59be0733-70f5-43d9-a191-d1810f0dbf8d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032964 Aug 10 23:25:18.798011 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 450/905] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:25:18.813258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7e7ded1b-8643-4e0e-bf89-7a3bea1536d6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:18.822439 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7e7ded1b-8643-4e0e-bf89-7a3bea1536d6 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1604 microversion: 2.1 time: 0.102761 Aug 10 23:25:18.823251 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 456/906] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:18 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1604 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:19.844792 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:19.845617 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:19.854459 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:19.861548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:19.861548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:19.861548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:19.861548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:19.861965 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:19.899835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:19.900320 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:19.900756 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:19.901203 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lazy-loading 'fault' on Instance uuid d6ed0bfa-e1e6-429e-b615-567dbbc217a9 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:25:19.913177 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:25:19.913698 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Wed Aug 10 23:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:25:19.943272 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:19.950250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e0a4fbbe-3fa1-4a04-aa12-d0bd9bae2325 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 200 len: 1326 microversion: 2.1 time: 0.109714 Aug 10 23:25:19.950895 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 451/907] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:19 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:20.977213 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:20.977823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:20.984389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:20.984864 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:20.985294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:20.985979 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:20.986429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:20.986893 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:21.000378 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] HTTP exception thrown: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Request method failure captured: Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 HTTP/1.1 Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D05e135eKtqlb537ipuj3GVo7oxhgqyC5JOY2K79MRmLAA5FYxNeQQVo-Mpe2dVXPlIPR7sFvD09yuD7TxZ1UJqXxf-RSG-_NfdM0vDaAvUOBkgble_fjKMBI2nUw3JtDk_as2biImmvLY0E-CioQZPbeVjQOdNY31Rk5_V2gfmNE8 Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:25:21.001925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e72afdc971a44dd6a4eaabd40c40bbcb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 35af5d49420a437193f2525bda7550d9 Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:25:21.003655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'd6ed0bfa-e1e6-429e-b615-567dbbc217a9'} Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:25:21.004759 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:25:21.006400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:25:21.008163 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Returning 404 to user: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:25:21.008163 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-15d6f829-f128-4c33-8203-75fb4eabc254 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 404 len: 111 microversion: 2.1 time: 0.029934 Aug 10 23:25:21.008163 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 457/908] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:20 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:25:21.012242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f8639731-601f-4e3e-b289-2f1576719fe1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '.version_select at 0x7fe8404d7670>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:21.130832 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f8639731-601f-4e3e-b289-2f1576719fe1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-736967743" status: 202 len: 0 microversion: 2.1 time: 0.122295 Aug 10 23:25:21.131405 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 452/909] 10.222.0.78 () {58 vars in 1218 bytes} [Wed Aug 10 23:25:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-736967743 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:25:21.970528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-70d4dcea-b4da-4907-869d-bb930a6f06fc tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'create', calling method: .version_select at 0x7fe833c751f0>, body: {"keypair": {"name": "tempest-keypair-1149015379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh+B2DiUNEw4kbERRFr6/tbRlnxoComnrCU6+WOW2JxFTroWNJxBKxR/uIW/BiLzUq14j8Oi65YhgZ55Fzs4fxT/rig/yKfhSFfbGSP9cL89QzioqRyzhcOrDR1vb5Mog=="}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:21.986883 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-70d4dcea-b4da-4907-869d-bb930a6f06fc tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Getting quotas for project e72afdc971a44dd6a4eaabd40c40bbcb. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:25:21.990824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-70d4dcea-b4da-4907-869d-bb930a6f06fc tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Getting quotas for user 35af5d49420a437193f2525bda7550d9 and project e72afdc971a44dd6a4eaabd40c40bbcb. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:25:22.079839 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-70d4dcea-b4da-4907-869d-bb930a6f06fc tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113282 Aug 10 23:25:22.080576 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 458/910] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 10 23:25:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:24.642377 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1795826700", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a06e0c39-ab76-4832-8445-cbc86e99f9b0"}], "security_groups": [{"name": "tempest-securitygroup--1457066786"}], "key_name": "tempest-keypair-1149015379", "user_data": "}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:24.850736 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] validate_networks() for [('a06e0c39-ab76-4832-8445-cbc86e99f9b0', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:25:25.279740 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:25:25.280118 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:25:25.280597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:25:25.281009 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:25:25.281437 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:25:25.290488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:25.291007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:25.295423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:25.295423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:25.295423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:25.295423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:25.310631 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Getting quotas for project e72afdc971a44dd6a4eaabd40c40bbcb. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:25:25.314635 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Getting quotas for user 35af5d49420a437193f2525bda7550d9 and project e72afdc971a44dd6a4eaabd40c40bbcb. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:25:25.326343 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:25:25.331110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:25:25.476256 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-916e29e6-f887-4ebe-96f6-c91915c38343 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.838615 Aug 10 23:25:25.477034 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 453/911] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:25:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:25:25.489789 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6172f0b7-0a76-4516-93be-161de5f18d52 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:25.490648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6172f0b7-0a76-4516-93be-161de5f18d52 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:25.549339 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6172f0b7-0a76-4516-93be-161de5f18d52 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:25.556905 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6172f0b7-0a76-4516-93be-161de5f18d52 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1238 microversion: 2.1 time: 0.073019 Aug 10 23:25:25.557500 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 459/912] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:25 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:26.577665 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dbfaf0d2-afbb-4ac6-9fec-f614e97fcc5e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:26.578281 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dbfaf0d2-afbb-4ac6-9fec-f614e97fcc5e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:26.585201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbfaf0d2-afbb-4ac6-9fec-f614e97fcc5e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:26.585688 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbfaf0d2-afbb-4ac6-9fec-f614e97fcc5e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:26.586134 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbfaf0d2-afbb-4ac6-9fec-f614e97fcc5e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:26.586894 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbfaf0d2-afbb-4ac6-9fec-f614e97fcc5e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:26.587355 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbfaf0d2-afbb-4ac6-9fec-f614e97fcc5e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:26.587784 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dbfaf0d2-afbb-4ac6-9fec-f614e97fcc5e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:26.651684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-dbfaf0d2-afbb-4ac6-9fec-f614e97fcc5e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:26.659314 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dbfaf0d2-afbb-4ac6-9fec-f614e97fcc5e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1242 microversion: 2.1 time: 0.085889 Aug 10 23:25:26.659896 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 454/913] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:26 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:27.679908 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-17a2ff3c-34d0-45dc-8dc6-99c39b79b6ee tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:27.681136 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-17a2ff3c-34d0-45dc-8dc6-99c39b79b6ee tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:27.693660 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17a2ff3c-34d0-45dc-8dc6-99c39b79b6ee tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:27.693660 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17a2ff3c-34d0-45dc-8dc6-99c39b79b6ee tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:27.693660 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17a2ff3c-34d0-45dc-8dc6-99c39b79b6ee tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:27.693660 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17a2ff3c-34d0-45dc-8dc6-99c39b79b6ee tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:27.694158 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17a2ff3c-34d0-45dc-8dc6-99c39b79b6ee tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:27.694158 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-17a2ff3c-34d0-45dc-8dc6-99c39b79b6ee tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:27.772409 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-17a2ff3c-34d0-45dc-8dc6-99c39b79b6ee tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:27.779953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-17a2ff3c-34d0-45dc-8dc6-99c39b79b6ee tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1298 microversion: 2.1 time: 0.103970 Aug 10 23:25:27.780683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 460/914] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:27 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:28.800959 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4be18ff9-9094-4cac-9f71-e311d8b7b93c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:28.802718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4be18ff9-9094-4cac-9f71-e311d8b7b93c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:28.808889 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4be18ff9-9094-4cac-9f71-e311d8b7b93c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:28.809438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4be18ff9-9094-4cac-9f71-e311d8b7b93c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:28.810067 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4be18ff9-9094-4cac-9f71-e311d8b7b93c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:28.810818 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4be18ff9-9094-4cac-9f71-e311d8b7b93c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:28.811282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4be18ff9-9094-4cac-9f71-e311d8b7b93c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:28.811712 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4be18ff9-9094-4cac-9f71-e311d8b7b93c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:29.030875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4be18ff9-9094-4cac-9f71-e311d8b7b93c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:29.038391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4be18ff9-9094-4cac-9f71-e311d8b7b93c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1364 microversion: 2.1 time: 0.241603 Aug 10 23:25:29.039197 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 455/915] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:28 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:29.503116 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-096716d1-286f-4839-b05a-b997819c8322 req-86f3184e-3f8e-4d14-b04b-1c6b5b138648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca161c9-6a61-4165-9b4d-3fed252d1aa7", "tag": "ebd93707-0e2b-4d56-8e8c-441e4035a649"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:29.513716 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-096716d1-286f-4839-b05a-b997819c8322 req-86f3184e-3f8e-4d14-b04b-1c6b5b138648 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:29.514197 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-096716d1-286f-4839-b05a-b997819c8322 req-86f3184e-3f8e-4d14-b04b-1c6b5b138648 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:29.514641 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-096716d1-286f-4839-b05a-b997819c8322 req-86f3184e-3f8e-4d14-b04b-1c6b5b138648 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:29.526642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-096716d1-286f-4839-b05a-b997819c8322 req-86f3184e-3f8e-4d14-b04b-1c6b5b138648 service nova] Creating event network-changed:ebd93707-0e2b-4d56-8e8c-441e4035a649 for instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 on hv-cinder-85144 Aug 10 23:25:29.531979 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-096716d1-286f-4839-b05a-b997819c8322 req-86f3184e-3f8e-4d14-b04b-1c6b5b138648 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032686 Aug 10 23:25:29.532573 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 461/916] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:30.059776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d3c9adb0-230d-45ce-baaf-101b8aad7677 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:30.067591 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d3c9adb0-230d-45ce-baaf-101b8aad7677 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:30.067591 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3c9adb0-230d-45ce-baaf-101b8aad7677 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:30.067591 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3c9adb0-230d-45ce-baaf-101b8aad7677 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:30.067591 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3c9adb0-230d-45ce-baaf-101b8aad7677 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:30.068282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3c9adb0-230d-45ce-baaf-101b8aad7677 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:30.068749 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3c9adb0-230d-45ce-baaf-101b8aad7677 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:30.069209 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3c9adb0-230d-45ce-baaf-101b8aad7677 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:30.199168 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-926811218", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1887301686", "security_groups": [{"name": "tempest-secgroup-smoke-2115761121"}], "block_device_mapping_v2": [{"uuid": "8582815f-60d1-4433-8be4-cd86e1d35cac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "261d6c55-7a8c-4ed0-b668-a538a8c25216"}]}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:30.330486 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d3c9adb0-230d-45ce-baaf-101b8aad7677 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:30.339710 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d3c9adb0-230d-45ce-baaf-101b8aad7677 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1364 microversion: 2.1 time: 0.283753 Aug 10 23:25:30.342172 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 456/917] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:30 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:30.359649 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.network.neutron [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] validate_networks() for [('261d6c55-7a8c-4ed0-b668-a538a8c25216', None, None, None, None, None)] {{(pid=121332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:25:30.796817 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Flavor limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:25:30.797339 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Image limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:25:30.797707 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Flavor pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:25:30.798118 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Image pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:25:30.798555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:25:30.807824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:30.808307 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:30.808753 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:30.809482 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:30.809936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:30.810363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:30.827873 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Getting quotas for project 8d2bfa865669477f8757e977da29420a. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:25:30.832218 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Getting quotas for user 05e18a4fd73e435aa6d0f10a37405698 and project 8d2bfa865669477f8757e977da29420a. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:25:30.892112 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Going to run 1 instances... {{(pid=121332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:25:30.894475 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8582815f-60d1-4433-8be4-cd86e1d35cac',volume_size=None,volume_type=None)] {{(pid=121332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:25:31.360940 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dd346018-5f5f-43f8-bc6b-cf2e4c7983cb tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:31.361556 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dd346018-5f5f-43f8-bc6b-cf2e4c7983cb tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:31.368556 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd346018-5f5f-43f8-bc6b-cf2e4c7983cb tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:31.369186 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd346018-5f5f-43f8-bc6b-cf2e4c7983cb tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:31.369629 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd346018-5f5f-43f8-bc6b-cf2e4c7983cb tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:31.370329 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd346018-5f5f-43f8-bc6b-cf2e4c7983cb tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:31.370827 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd346018-5f5f-43f8-bc6b-cf2e4c7983cb tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:31.371256 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dd346018-5f5f-43f8-bc6b-cf2e4c7983cb tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:31.470102 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-01d5236f-d073-4a54-9aa2-2b581be11a54 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.275113 Aug 10 23:25:31.471186 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 462/918] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:25:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:25:31.484663 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-17d084ae-f8b0-46b4-a838-19caf0f20d1c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:31.485539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-17d084ae-f8b0-46b4-a838-19caf0f20d1c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:31.521416 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-dd346018-5f5f-43f8-bc6b-cf2e4c7983cb tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:31.532635 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dd346018-5f5f-43f8-bc6b-cf2e4c7983cb tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1364 microversion: 2.1 time: 0.175356 Aug 10 23:25:31.543191 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 457/919] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:31 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:25:31.556006 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-17d084ae-f8b0-46b4-a838-19caf0f20d1c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:31.563372 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-17d084ae-f8b0-46b4-a838-19caf0f20d1c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1094 microversion: 2.1 time: 0.083869 Aug 10 23:25:31.564069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 463/920] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:31 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:25:32.555952 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-cb609255-6c83-4eca-87d1-1a553492e97f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:32.556596 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-cb609255-6c83-4eca-87d1-1a553492e97f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:32.562980 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb609255-6c83-4eca-87d1-1a553492e97f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:32.563472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb609255-6c83-4eca-87d1-1a553492e97f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:32.563911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb609255-6c83-4eca-87d1-1a553492e97f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:32.564648 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb609255-6c83-4eca-87d1-1a553492e97f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:32.565105 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb609255-6c83-4eca-87d1-1a553492e97f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:32.565530 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb609255-6c83-4eca-87d1-1a553492e97f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:32.583704 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d680d2bc-16a9-454c-86d4-157226c8ceba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:32.584589 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d680d2bc-16a9-454c-86d4-157226c8ceba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:32.675765 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d680d2bc-16a9-454c-86d4-157226c8ceba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:32.683014 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d680d2bc-16a9-454c-86d4-157226c8ceba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1094 microversion: 2.1 time: 0.103094 Aug 10 23:25:32.683577 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 464/921] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:32 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1094 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:25:32.799235 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-cb609255-6c83-4eca-87d1-1a553492e97f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:32.807231 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-cb609255-6c83-4eca-87d1-1a553492e97f tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1364 microversion: 2.1 time: 0.255800 Aug 10 23:25:32.807802 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 458/922] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:32 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:33.707020 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-257d4855-d468-4794-af97-afbff5754489 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:33.708322 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-257d4855-d468-4794-af97-afbff5754489 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:33.714746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-257d4855-d468-4794-af97-afbff5754489 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:33.715235 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-257d4855-d468-4794-af97-afbff5754489 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:33.715673 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-257d4855-d468-4794-af97-afbff5754489 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:33.716372 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-257d4855-d468-4794-af97-afbff5754489 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:33.716834 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-257d4855-d468-4794-af97-afbff5754489 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:33.717266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-257d4855-d468-4794-af97-afbff5754489 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:33.795871 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-257d4855-d468-4794-af97-afbff5754489 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:33.815396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-257d4855-d468-4794-af97-afbff5754489 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1136 microversion: 2.1 time: 0.112434 Aug 10 23:25:33.820620 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 465/923] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:33 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1136 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:33.829470 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a9ec14fe-2bfe-471c-ae7a-7b310dfd6fa1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:33.830072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a9ec14fe-2bfe-471c-ae7a-7b310dfd6fa1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:33.837405 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9ec14fe-2bfe-471c-ae7a-7b310dfd6fa1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:33.838193 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9ec14fe-2bfe-471c-ae7a-7b310dfd6fa1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:33.838832 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9ec14fe-2bfe-471c-ae7a-7b310dfd6fa1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:33.839733 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9ec14fe-2bfe-471c-ae7a-7b310dfd6fa1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:33.843858 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9ec14fe-2bfe-471c-ae7a-7b310dfd6fa1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:33.843858 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a9ec14fe-2bfe-471c-ae7a-7b310dfd6fa1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:34.002388 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a9ec14fe-2bfe-471c-ae7a-7b310dfd6fa1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:34.011054 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a9ec14fe-2bfe-471c-ae7a-7b310dfd6fa1 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1364 microversion: 2.1 time: 0.186000 Aug 10 23:25:34.018560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 459/924] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:33 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:34.838075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b200a94e-4357-4d68-8435-ce51a0d7409e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:34.839476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b200a94e-4357-4d68-8435-ce51a0d7409e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:34.846390 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b200a94e-4357-4d68-8435-ce51a0d7409e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:34.854194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b200a94e-4357-4d68-8435-ce51a0d7409e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:34.854194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b200a94e-4357-4d68-8435-ce51a0d7409e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:34.854194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b200a94e-4357-4d68-8435-ce51a0d7409e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:34.854194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b200a94e-4357-4d68-8435-ce51a0d7409e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:34.854580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b200a94e-4357-4d68-8435-ce51a0d7409e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:35.036420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4fef1a83-796e-4e4f-ab91-cde9b66ac750 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:35.037067 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4fef1a83-796e-4e4f-ab91-cde9b66ac750 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:35.047900 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4fef1a83-796e-4e4f-ab91-cde9b66ac750 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:35.048491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4fef1a83-796e-4e4f-ab91-cde9b66ac750 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:35.049049 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4fef1a83-796e-4e4f-ab91-cde9b66ac750 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:35.049633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4fef1a83-796e-4e4f-ab91-cde9b66ac750 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:35.053749 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4fef1a83-796e-4e4f-ab91-cde9b66ac750 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:35.054385 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4fef1a83-796e-4e4f-ab91-cde9b66ac750 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:35.300835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:35.313986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b200a94e-4357-4d68-8435-ce51a0d7409e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:35.322107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=6 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:35.331182 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b200a94e-4357-4d68-8435-ce51a0d7409e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1200 microversion: 2.1 time: 0.495942 Aug 10 23:25:35.332771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 466/925] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:34 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1200 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:35.442884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4fef1a83-796e-4e4f-ab91-cde9b66ac750 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:35.452144 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4fef1a83-796e-4e4f-ab91-cde9b66ac750 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1364 microversion: 2.1 time: 0.423039 Aug 10 23:25:35.453244 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 460/926] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:35 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1364 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:25:36.357244 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b7d26ef1-f717-4957-968a-b463fadb1b02 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:36.358844 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b7d26ef1-f717-4957-968a-b463fadb1b02 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:36.370176 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b7d26ef1-f717-4957-968a-b463fadb1b02 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:36.371428 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b7d26ef1-f717-4957-968a-b463fadb1b02 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:36.372955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b7d26ef1-f717-4957-968a-b463fadb1b02 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:36.373979 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b7d26ef1-f717-4957-968a-b463fadb1b02 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:36.377014 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b7d26ef1-f717-4957-968a-b463fadb1b02 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:36.377014 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b7d26ef1-f717-4957-968a-b463fadb1b02 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:36.477876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9ac52963-81f8-47c9-9fc0-0e05e8c7a854 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:36.482362 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9ac52963-81f8-47c9-9fc0-0e05e8c7a854 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:36.504939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9ac52963-81f8-47c9-9fc0-0e05e8c7a854 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:36.506068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9ac52963-81f8-47c9-9fc0-0e05e8c7a854 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:36.506640 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9ac52963-81f8-47c9-9fc0-0e05e8c7a854 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:36.507718 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9ac52963-81f8-47c9-9fc0-0e05e8c7a854 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:36.508547 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9ac52963-81f8-47c9-9fc0-0e05e8c7a854 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:36.509149 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9ac52963-81f8-47c9-9fc0-0e05e8c7a854 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:36.658823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b7d26ef1-f717-4957-968a-b463fadb1b02 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:36.674309 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b7d26ef1-f717-4957-968a-b463fadb1b02 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1278 microversion: 2.1 time: 0.326070 Aug 10 23:25:36.679021 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 467/927] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:36 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1278 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:36.773490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9ac52963-81f8-47c9-9fc0-0e05e8c7a854 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:36.784152 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9ac52963-81f8-47c9-9fc0-0e05e8c7a854 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1364 microversion: 2.1 time: 0.313450 Aug 10 23:25:36.788100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 461/928] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:36 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:37.002005 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-a47ea925-a85e-4def-901f-396c438c2512 req-74a5588a-8e0e-42dd-8bc1-b5b4fe488b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca161c9-6a61-4165-9b4d-3fed252d1aa7", "name": "network-vif-plugged", "status": "completed", "tag": "ebd93707-0e2b-4d56-8e8c-441e4035a649"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:37.016543 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a47ea925-a85e-4def-901f-396c438c2512 req-74a5588a-8e0e-42dd-8bc1-b5b4fe488b8e service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:37.017188 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a47ea925-a85e-4def-901f-396c438c2512 req-74a5588a-8e0e-42dd-8bc1-b5b4fe488b8e service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:37.017750 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a47ea925-a85e-4def-901f-396c438c2512 req-74a5588a-8e0e-42dd-8bc1-b5b4fe488b8e service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:37.052060 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-a47ea925-a85e-4def-901f-396c438c2512 req-74a5588a-8e0e-42dd-8bc1-b5b4fe488b8e service nova] Creating event network-vif-plugged:ebd93707-0e2b-4d56-8e8c-441e4035a649 for instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 on hv-cinder-85144 Aug 10 23:25:37.058290 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-a47ea925-a85e-4def-901f-396c438c2512 req-74a5588a-8e0e-42dd-8bc1-b5b4fe488b8e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200628 Aug 10 23:25:37.059689 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 468/929] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:37.393152 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-d3d125ca-7b76-479f-a8f9-f2ef884f23b2 req-82aa5071-7604-44f0-8e69-8602b210562a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b873b552-1351-4f68-88f2-08fc66c4e21c", "tag": "9ed91d66-53a0-4ddd-a2be-ade214566003"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:37.404782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-d3d125ca-7b76-479f-a8f9-f2ef884f23b2 req-82aa5071-7604-44f0-8e69-8602b210562a service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:37.405357 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-d3d125ca-7b76-479f-a8f9-f2ef884f23b2 req-82aa5071-7604-44f0-8e69-8602b210562a service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:37.405866 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-d3d125ca-7b76-479f-a8f9-f2ef884f23b2 req-82aa5071-7604-44f0-8e69-8602b210562a service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:37.418337 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-d3d125ca-7b76-479f-a8f9-f2ef884f23b2 req-82aa5071-7604-44f0-8e69-8602b210562a service nova] Creating event network-changed:9ed91d66-53a0-4ddd-a2be-ade214566003 for instance b873b552-1351-4f68-88f2-08fc66c4e21c on hv-cinder-85144 Aug 10 23:25:37.423363 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-d3d125ca-7b76-479f-a8f9-f2ef884f23b2 req-82aa5071-7604-44f0-8e69-8602b210562a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034161 Aug 10 23:25:37.424425 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 462/930] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:37.701151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6cc9333d-2cef-4156-a9ab-aa7a98a210d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:37.701822 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6cc9333d-2cef-4156-a9ab-aa7a98a210d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:37.709501 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc9333d-2cef-4156-a9ab-aa7a98a210d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:37.710203 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc9333d-2cef-4156-a9ab-aa7a98a210d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:37.710639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc9333d-2cef-4156-a9ab-aa7a98a210d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:37.711369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc9333d-2cef-4156-a9ab-aa7a98a210d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:37.711899 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc9333d-2cef-4156-a9ab-aa7a98a210d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:37.712318 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6cc9333d-2cef-4156-a9ab-aa7a98a210d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:37.808175 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-441753c7-25ff-47e9-b621-5ab0c7d424be tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:37.809921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-441753c7-25ff-47e9-b621-5ab0c7d424be tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:37.820060 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-441753c7-25ff-47e9-b621-5ab0c7d424be tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:37.820952 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-441753c7-25ff-47e9-b621-5ab0c7d424be tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:37.823177 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-441753c7-25ff-47e9-b621-5ab0c7d424be tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:37.824186 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-441753c7-25ff-47e9-b621-5ab0c7d424be tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:37.825728 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-441753c7-25ff-47e9-b621-5ab0c7d424be tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:37.826422 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-441753c7-25ff-47e9-b621-5ab0c7d424be tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:37.864904 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6cc9333d-2cef-4156-a9ab-aa7a98a210d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:37.873139 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6cc9333d-2cef-4156-a9ab-aa7a98a210d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.176806 Aug 10 23:25:37.881848 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 469/931] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:37 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:38.116325 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-441753c7-25ff-47e9-b621-5ab0c7d424be tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:38.134921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-441753c7-25ff-47e9-b621-5ab0c7d424be tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1364 microversion: 2.1 time: 0.324291 Aug 10 23:25:38.134921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 463/932] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:37 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:38.897164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-dceab66f-b9a2-4481-b9ea-609d8856bb1d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:38.897780 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-dceab66f-b9a2-4481-b9ea-609d8856bb1d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:38.906702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dceab66f-b9a2-4481-b9ea-609d8856bb1d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:38.906702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dceab66f-b9a2-4481-b9ea-609d8856bb1d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:38.906702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dceab66f-b9a2-4481-b9ea-609d8856bb1d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:38.906702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dceab66f-b9a2-4481-b9ea-609d8856bb1d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:38.907179 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dceab66f-b9a2-4481-b9ea-609d8856bb1d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:38.907440 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-dceab66f-b9a2-4481-b9ea-609d8856bb1d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:39.057761 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-dceab66f-b9a2-4481-b9ea-609d8856bb1d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:39.066130 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-dceab66f-b9a2-4481-b9ea-609d8856bb1d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.173107 Aug 10 23:25:39.069416 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 470/933] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:38 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:39.156776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-00b90686-6fc5-4ee5-a596-bbac4f6b7768 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:39.157560 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-00b90686-6fc5-4ee5-a596-bbac4f6b7768 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:39.164525 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-00b90686-6fc5-4ee5-a596-bbac4f6b7768 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:39.165017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-00b90686-6fc5-4ee5-a596-bbac4f6b7768 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:39.165456 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-00b90686-6fc5-4ee5-a596-bbac4f6b7768 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:39.166178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-00b90686-6fc5-4ee5-a596-bbac4f6b7768 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:39.166642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-00b90686-6fc5-4ee5-a596-bbac4f6b7768 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:39.167101 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-00b90686-6fc5-4ee5-a596-bbac4f6b7768 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:39.387432 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-00b90686-6fc5-4ee5-a596-bbac4f6b7768 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:39.396845 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-00b90686-6fc5-4ee5-a596-bbac4f6b7768 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1364 microversion: 2.1 time: 0.244126 Aug 10 23:25:39.397651 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 464/934] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:39 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:40.088689 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d179f490-213b-47f4-aeb0-216f74501a11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:40.089302 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d179f490-213b-47f4-aeb0-216f74501a11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:40.095960 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d179f490-213b-47f4-aeb0-216f74501a11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:40.097544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d179f490-213b-47f4-aeb0-216f74501a11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:40.097544 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d179f490-213b-47f4-aeb0-216f74501a11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:40.099100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d179f490-213b-47f4-aeb0-216f74501a11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:40.100125 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d179f490-213b-47f4-aeb0-216f74501a11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:40.100562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d179f490-213b-47f4-aeb0-216f74501a11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:40.252527 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-d179f490-213b-47f4-aeb0-216f74501a11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:40.261121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d179f490-213b-47f4-aeb0-216f74501a11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.176274 Aug 10 23:25:40.262893 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 471/935] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:40 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:40.417909 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a6182525-f988-4a78-9d38-3a1994e382e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:40.419499 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a6182525-f988-4a78-9d38-3a1994e382e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:40.428820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6182525-f988-4a78-9d38-3a1994e382e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:40.429526 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6182525-f988-4a78-9d38-3a1994e382e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:40.430132 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6182525-f988-4a78-9d38-3a1994e382e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:40.431073 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6182525-f988-4a78-9d38-3a1994e382e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:40.431997 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6182525-f988-4a78-9d38-3a1994e382e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:40.432658 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a6182525-f988-4a78-9d38-3a1994e382e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:40.575203 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a6182525-f988-4a78-9d38-3a1994e382e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:40.593064 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a6182525-f988-4a78-9d38-3a1994e382e7 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1551 microversion: 2.1 time: 0.178930 Aug 10 23:25:40.593659 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 465/936] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:40 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1551 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:40.617684 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-814eca88-62bf-4f7b-8b3a-9178c84ee31a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:40.617684 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-814eca88-62bf-4f7b-8b3a-9178c84ee31a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:40.622835 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-814eca88-62bf-4f7b-8b3a-9178c84ee31a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:40.623514 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-814eca88-62bf-4f7b-8b3a-9178c84ee31a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:40.623960 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-814eca88-62bf-4f7b-8b3a-9178c84ee31a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:40.624706 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-814eca88-62bf-4f7b-8b3a-9178c84ee31a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:40.625118 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-814eca88-62bf-4f7b-8b3a-9178c84ee31a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:40.625748 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-814eca88-62bf-4f7b-8b3a-9178c84ee31a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:40.720819 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-814eca88-62bf-4f7b-8b3a-9178c84ee31a tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110765 Aug 10 23:25:40.721856 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 472/937] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 10 23:25:40 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:41.281699 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f68e6e60-8f0e-4e8e-98d9-b510cb9e830d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:41.282609 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f68e6e60-8f0e-4e8e-98d9-b510cb9e830d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:41.292100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f68e6e60-8f0e-4e8e-98d9-b510cb9e830d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:41.292100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f68e6e60-8f0e-4e8e-98d9-b510cb9e830d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:41.292100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f68e6e60-8f0e-4e8e-98d9-b510cb9e830d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:41.292100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f68e6e60-8f0e-4e8e-98d9-b510cb9e830d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:41.292501 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f68e6e60-8f0e-4e8e-98d9-b510cb9e830d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:41.292501 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f68e6e60-8f0e-4e8e-98d9-b510cb9e830d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:41.296644 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=100 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:41.602537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f68e6e60-8f0e-4e8e-98d9-b510cb9e830d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:41.616742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f68e6e60-8f0e-4e8e-98d9-b510cb9e830d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.339057 Aug 10 23:25:41.631698 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 466/938] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:41 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:42.063592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:42.068140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-63f849d9-5112-4726-99d0-98d7db46297d req-3261c8f8-f360-48bf-bcf3-78b3849a00f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca161c9-6a61-4165-9b4d-3fed252d1aa7", "tag": "ebd93707-0e2b-4d56-8e8c-441e4035a649"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:42.089884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-63f849d9-5112-4726-99d0-98d7db46297d req-3261c8f8-f360-48bf-bcf3-78b3849a00f8 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:42.090937 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-63f849d9-5112-4726-99d0-98d7db46297d req-3261c8f8-f360-48bf-bcf3-78b3849a00f8 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:42.091695 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-63f849d9-5112-4726-99d0-98d7db46297d req-3261c8f8-f360-48bf-bcf3-78b3849a00f8 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:42.109502 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-63f849d9-5112-4726-99d0-98d7db46297d req-3261c8f8-f360-48bf-bcf3-78b3849a00f8 service nova] Creating event network-changed:ebd93707-0e2b-4d56-8e8c-441e4035a649 for instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 on hv-cinder-85144 Aug 10 23:25:42.126739 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-63f849d9-5112-4726-99d0-98d7db46297d req-3261c8f8-f360-48bf-bcf3-78b3849a00f8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063743 Aug 10 23:25:42.127359 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 473/939] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:25:42.637779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-aa133f90-a02f-4d91-89e4-af4fb8d439bf tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:42.639148 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-aa133f90-a02f-4d91-89e4-af4fb8d439bf tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:42.651281 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa133f90-a02f-4d91-89e4-af4fb8d439bf tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:42.652924 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa133f90-a02f-4d91-89e4-af4fb8d439bf tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:42.653576 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa133f90-a02f-4d91-89e4-af4fb8d439bf tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:42.665373 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa133f90-a02f-4d91-89e4-af4fb8d439bf tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:42.666273 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa133f90-a02f-4d91-89e4-af4fb8d439bf tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:42.666978 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-aa133f90-a02f-4d91-89e4-af4fb8d439bf tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:43.230629 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-aa133f90-a02f-4d91-89e4-af4fb8d439bf tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:43.243291 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-aa133f90-a02f-4d91-89e4-af4fb8d439bf tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.609558 Aug 10 23:25:43.259559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 467/940] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:42 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:44.262673 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=16 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:44.267651 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a76861dd-ed97-498e-83fe-d8ef0ff00854 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:44.268564 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a76861dd-ed97-498e-83fe-d8ef0ff00854 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:44.275351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a76861dd-ed97-498e-83fe-d8ef0ff00854 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:44.275845 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a76861dd-ed97-498e-83fe-d8ef0ff00854 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:44.276289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a76861dd-ed97-498e-83fe-d8ef0ff00854 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:44.277000 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a76861dd-ed97-498e-83fe-d8ef0ff00854 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:44.277456 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a76861dd-ed97-498e-83fe-d8ef0ff00854 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:44.277895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a76861dd-ed97-498e-83fe-d8ef0ff00854 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:44.478538 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a76861dd-ed97-498e-83fe-d8ef0ff00854 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:44.487368 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a76861dd-ed97-498e-83fe-d8ef0ff00854 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.225543 Aug 10 23:25:44.488083 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 474/941] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:44 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:45.509149 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e15c137b-52b2-4ab4-97ef-bef94d6321f1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:45.510474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e15c137b-52b2-4ab4-97ef-bef94d6321f1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:45.517968 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e15c137b-52b2-4ab4-97ef-bef94d6321f1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:45.518414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e15c137b-52b2-4ab4-97ef-bef94d6321f1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:45.518958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e15c137b-52b2-4ab4-97ef-bef94d6321f1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:45.519891 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e15c137b-52b2-4ab4-97ef-bef94d6321f1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:45.520358 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e15c137b-52b2-4ab4-97ef-bef94d6321f1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:45.520799 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e15c137b-52b2-4ab4-97ef-bef94d6321f1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:45.742936 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e15c137b-52b2-4ab4-97ef-bef94d6321f1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:45.752067 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e15c137b-52b2-4ab4-97ef-bef94d6321f1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.246810 Aug 10 23:25:45.752948 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 468/942] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:45 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:46.773858 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b4a82df7-8cb3-4d0c-840b-41d6d23f320a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:46.774474 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b4a82df7-8cb3-4d0c-840b-41d6d23f320a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:46.778683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:46.782432 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b4a82df7-8cb3-4d0c-840b-41d6d23f320a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:46.782945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b4a82df7-8cb3-4d0c-840b-41d6d23f320a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:46.783420 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b4a82df7-8cb3-4d0c-840b-41d6d23f320a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:46.784135 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b4a82df7-8cb3-4d0c-840b-41d6d23f320a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:46.784599 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b4a82df7-8cb3-4d0c-840b-41d6d23f320a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:46.785029 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b4a82df7-8cb3-4d0c-840b-41d6d23f320a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:46.789121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:46.929687 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b4a82df7-8cb3-4d0c-840b-41d6d23f320a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:46.937838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b4a82df7-8cb3-4d0c-840b-41d6d23f320a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.168466 Aug 10 23:25:46.938424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 475/943] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:46 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:47.964363 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7e8ee87e-c8f3-46f7-9157-8e42897a5016 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:47.966174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7e8ee87e-c8f3-46f7-9157-8e42897a5016 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:47.968989 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:47.976261 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8ee87e-c8f3-46f7-9157-8e42897a5016 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:47.977175 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8ee87e-c8f3-46f7-9157-8e42897a5016 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:47.980193 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8ee87e-c8f3-46f7-9157-8e42897a5016 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:47.980193 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8ee87e-c8f3-46f7-9157-8e42897a5016 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:47.980193 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8ee87e-c8f3-46f7-9157-8e42897a5016 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:47.980882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e8ee87e-c8f3-46f7-9157-8e42897a5016 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:48.236919 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7e8ee87e-c8f3-46f7-9157-8e42897a5016 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:48.257019 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7e8ee87e-c8f3-46f7-9157-8e42897a5016 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.296484 Aug 10 23:25:48.257610 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 469/944] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:47 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:49.280854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1c5b9a5b-819a-4a0f-8cd2-4469502935d5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:49.286468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1c5b9a5b-819a-4a0f-8cd2-4469502935d5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:49.310947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c5b9a5b-819a-4a0f-8cd2-4469502935d5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:49.311870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c5b9a5b-819a-4a0f-8cd2-4469502935d5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:49.312542 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c5b9a5b-819a-4a0f-8cd2-4469502935d5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:49.314278 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c5b9a5b-819a-4a0f-8cd2-4469502935d5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:49.319406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c5b9a5b-819a-4a0f-8cd2-4469502935d5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:49.320248 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1c5b9a5b-819a-4a0f-8cd2-4469502935d5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:49.522851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1c5b9a5b-819a-4a0f-8cd2-4469502935d5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:49.533625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1c5b9a5b-819a-4a0f-8cd2-4469502935d5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.259248 Aug 10 23:25:49.535623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 476/945] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:49 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:50.555283 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b2e696ac-80b2-468b-a60e-760a68a332ff tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:50.555868 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b2e696ac-80b2-468b-a60e-760a68a332ff tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:50.562087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b2e696ac-80b2-468b-a60e-760a68a332ff tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:50.562793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b2e696ac-80b2-468b-a60e-760a68a332ff tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:50.563234 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b2e696ac-80b2-468b-a60e-760a68a332ff tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:50.563922 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b2e696ac-80b2-468b-a60e-760a68a332ff tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:50.564385 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b2e696ac-80b2-468b-a60e-760a68a332ff tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:50.564817 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b2e696ac-80b2-468b-a60e-760a68a332ff tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:50.705451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b2e696ac-80b2-468b-a60e-760a68a332ff tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:50.713478 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b2e696ac-80b2-468b-a60e-760a68a332ff tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.162629 Aug 10 23:25:50.714472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 470/946] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:50 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:50.798703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-95d290a5-26c5-44bf-a93e-4788de0ad077 req-6e43c475-3834-4d23-a68d-66078c2d4818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b873b552-1351-4f68-88f2-08fc66c4e21c", "name": "network-vif-plugged", "status": "completed", "tag": "9ed91d66-53a0-4ddd-a2be-ade214566003"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:50.816183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-95d290a5-26c5-44bf-a93e-4788de0ad077 req-6e43c475-3834-4d23-a68d-66078c2d4818 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:50.816183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-95d290a5-26c5-44bf-a93e-4788de0ad077 req-6e43c475-3834-4d23-a68d-66078c2d4818 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:50.816183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-95d290a5-26c5-44bf-a93e-4788de0ad077 req-6e43c475-3834-4d23-a68d-66078c2d4818 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:50.826969 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-95d290a5-26c5-44bf-a93e-4788de0ad077 req-6e43c475-3834-4d23-a68d-66078c2d4818 service nova] Creating event network-vif-plugged:9ed91d66-53a0-4ddd-a2be-ade214566003 for instance b873b552-1351-4f68-88f2-08fc66c4e21c on hv-cinder-85144 Aug 10 23:25:50.832640 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-95d290a5-26c5-44bf-a93e-4788de0ad077 req-6e43c475-3834-4d23-a68d-66078c2d4818 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040506 Aug 10 23:25:50.833801 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 477/947] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:51.733541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2a982fbe-21c9-46bb-abca-9d94d45267a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:51.734087 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2a982fbe-21c9-46bb-abca-9d94d45267a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:51.740311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a982fbe-21c9-46bb-abca-9d94d45267a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:51.741081 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a982fbe-21c9-46bb-abca-9d94d45267a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:51.741531 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a982fbe-21c9-46bb-abca-9d94d45267a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:51.742255 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a982fbe-21c9-46bb-abca-9d94d45267a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:51.742745 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a982fbe-21c9-46bb-abca-9d94d45267a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:51.743184 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a982fbe-21c9-46bb-abca-9d94d45267a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:51.890636 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2a982fbe-21c9-46bb-abca-9d94d45267a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:51.898935 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2a982fbe-21c9-46bb-abca-9d94d45267a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.169284 Aug 10 23:25:51.910835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 471/948] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:51 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:52.926597 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c3a2d364-5b54-4a32-8117-2f58cf63b815 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:52.940237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c3a2d364-5b54-4a32-8117-2f58cf63b815 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:52.940237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a2d364-5b54-4a32-8117-2f58cf63b815 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:52.940237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a2d364-5b54-4a32-8117-2f58cf63b815 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:52.940237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a2d364-5b54-4a32-8117-2f58cf63b815 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:52.942565 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a2d364-5b54-4a32-8117-2f58cf63b815 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:52.943725 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a2d364-5b54-4a32-8117-2f58cf63b815 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:52.944816 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3a2d364-5b54-4a32-8117-2f58cf63b815 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:53.109432 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c3a2d364-5b54-4a32-8117-2f58cf63b815 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:53.118427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c3a2d364-5b54-4a32-8117-2f58cf63b815 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1266 microversion: 2.1 time: 0.201391 Aug 10 23:25:53.119433 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 478/949] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:52 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:54.138692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6deeac06-63cd-4fd3-a9d9-5548fb896056 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:54.139934 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6deeac06-63cd-4fd3-a9d9-5548fb896056 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:54.147011 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6deeac06-63cd-4fd3-a9d9-5548fb896056 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:54.147779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6deeac06-63cd-4fd3-a9d9-5548fb896056 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:54.148491 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6deeac06-63cd-4fd3-a9d9-5548fb896056 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:54.149696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6deeac06-63cd-4fd3-a9d9-5548fb896056 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:54.150400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6deeac06-63cd-4fd3-a9d9-5548fb896056 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:54.150928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6deeac06-63cd-4fd3-a9d9-5548fb896056 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:54.316185 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6deeac06-63cd-4fd3-a9d9-5548fb896056 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:54.325857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6deeac06-63cd-4fd3-a9d9-5548fb896056 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1453 microversion: 2.1 time: 0.190799 Aug 10 23:25:54.326638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 472/950] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:54 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:54.347107 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2e009719-7f68-4ed7-9efb-6c2426eedc57 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:54.348261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2e009719-7f68-4ed7-9efb-6c2426eedc57 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:54.355133 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e009719-7f68-4ed7-9efb-6c2426eedc57 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:54.355924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e009719-7f68-4ed7-9efb-6c2426eedc57 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:54.356634 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e009719-7f68-4ed7-9efb-6c2426eedc57 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:54.357605 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e009719-7f68-4ed7-9efb-6c2426eedc57 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:54.358279 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e009719-7f68-4ed7-9efb-6c2426eedc57 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:54.358736 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e009719-7f68-4ed7-9efb-6c2426eedc57 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:54.511052 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2e009719-7f68-4ed7-9efb-6c2426eedc57 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:54.521293 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2e009719-7f68-4ed7-9efb-6c2426eedc57 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1453 microversion: 2.1 time: 0.178006 Aug 10 23:25:54.522330 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 479/951] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:54 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:25:57.084606 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-82e5b081-02f9-45b7-bcee-2539fdf7d988 req-6b676612-f698-472f-afab-b41a90ae7a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b873b552-1351-4f68-88f2-08fc66c4e21c", "tag": "9ed91d66-53a0-4ddd-a2be-ade214566003"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:57.094196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-82e5b081-02f9-45b7-bcee-2539fdf7d988 req-6b676612-f698-472f-afab-b41a90ae7a06 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:57.094738 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-82e5b081-02f9-45b7-bcee-2539fdf7d988 req-6b676612-f698-472f-afab-b41a90ae7a06 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:57.095208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-82e5b081-02f9-45b7-bcee-2539fdf7d988 req-6b676612-f698-472f-afab-b41a90ae7a06 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:57.107094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-82e5b081-02f9-45b7-bcee-2539fdf7d988 req-6b676612-f698-472f-afab-b41a90ae7a06 service nova] Creating event network-changed:9ed91d66-53a0-4ddd-a2be-ade214566003 for instance b873b552-1351-4f68-88f2-08fc66c4e21c on hv-cinder-85144 Aug 10 23:25:57.114355 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-82e5b081-02f9-45b7-bcee-2539fdf7d988 req-6b676612-f698-472f-afab-b41a90ae7a06 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157220 Aug 10 23:25:57.114981 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 473/952] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:58.192085 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-57a94725-49e5-40ef-b21f-95ed3c754160 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Action: 'create', calling method: .version_select at 0x7fe8401aa040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-323430405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcq9hBSlGlRhMb3AkiI+XdWrzbEEYXYGa2cMkSxY35OhrWuTZ94ZpXkanWvNn6lfQOlBNkYcUFHfaXGHPnZVpk4YTIMxtgsmBSH7s7bcWFUHhcE2hZKAVYDl2xKnzQAFw=="}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:58.203656 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-57a94725-49e5-40ef-b21f-95ed3c754160 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Getting quotas for project 1fbc9fef5e46490da9e1142d70e04228. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:25:58.207671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-57a94725-49e5-40ef-b21f-95ed3c754160 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Getting quotas for user ef47061e975849c6ab4054f380f8527c and project 1fbc9fef5e46490da9e1142d70e04228. Resources: {'key_pairs'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:25:58.295720 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-57a94725-49e5-40ef-b21f-95ed3c754160 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.112765 Aug 10 23:25:58.296335 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 480/953] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 10 23:25:58 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:58.347938 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-22309435", "imageRef": "5c552898-369c-4f5c-b5c3-861666ae36f3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-323430405", "networks": [{"uuid": "3793538c-d90e-4c27-8d5b-0a31ee0adfa1"}]}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:58.398097 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] validate_networks() for [('3793538c-d90e-4c27-8d5b-0a31ee0adfa1', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:25:58.763614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:25:58.764043 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:25:58.764519 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:25:58.764937 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:25:58.765352 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:25:58.774619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:58.775135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:58.775569 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:58.776330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:58.776786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:58.777218 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:58.794007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Getting quotas for project 1fbc9fef5e46490da9e1142d70e04228. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:25:58.797949 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Getting quotas for user ef47061e975849c6ab4054f380f8527c and project 1fbc9fef5e46490da9e1142d70e04228. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:25:58.808766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:25:58.811037 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5c552898-369c-4f5c-b5c3-861666ae36f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:25:58.937998 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3ee94558-9101-4cdd-98a7-c5f96f7a8093 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594803 Aug 10 23:25:58.938637 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 474/954] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:25:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:25:58.949406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-03effb5e-1ab8-47c4-b55e-cd370eea1a97 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:58.950110 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-03effb5e-1ab8-47c4-b55e-cd370eea1a97 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:59.017451 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-03effb5e-1ab8-47c4-b55e-cd370eea1a97 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:59.025334 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-03effb5e-1ab8-47c4-b55e-cd370eea1a97 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1256 microversion: 2.1 time: 0.079789 Aug 10 23:25:59.026198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 481/955] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:25:58 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1256 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:00.047446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3dc0ee8d-6b12-4f3c-be78-96c6e8602607 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:00.048009 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3dc0ee8d-6b12-4f3c-be78-96c6e8602607 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:00.101042 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3dc0ee8d-6b12-4f3c-be78-96c6e8602607 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:00.107869 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3dc0ee8d-6b12-4f3c-be78-96c6e8602607 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1256 microversion: 2.1 time: 0.064963 Aug 10 23:26:00.109559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 475/956] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:00 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1256 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:01.129944 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2af3c1fb-b4d8-40b9-b62c-45131bb8faa9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:01.130562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2af3c1fb-b4d8-40b9-b62c-45131bb8faa9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:01.136958 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2af3c1fb-b4d8-40b9-b62c-45131bb8faa9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:01.137445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2af3c1fb-b4d8-40b9-b62c-45131bb8faa9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:01.137880 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2af3c1fb-b4d8-40b9-b62c-45131bb8faa9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:01.138687 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2af3c1fb-b4d8-40b9-b62c-45131bb8faa9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:01.139148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2af3c1fb-b4d8-40b9-b62c-45131bb8faa9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:01.139578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2af3c1fb-b4d8-40b9-b62c-45131bb8faa9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:01.200436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2af3c1fb-b4d8-40b9-b62c-45131bb8faa9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:01.207929 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2af3c1fb-b4d8-40b9-b62c-45131bb8faa9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1308 microversion: 2.1 time: 0.082513 Aug 10 23:26:01.208756 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 482/957] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:01 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1308 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:02.229448 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4dcad080-a3cf-4335-a713-2235446255ed tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:02.230328 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4dcad080-a3cf-4335-a713-2235446255ed tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:02.238209 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dcad080-a3cf-4335-a713-2235446255ed tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:02.243340 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dcad080-a3cf-4335-a713-2235446255ed tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:02.248715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dcad080-a3cf-4335-a713-2235446255ed tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:02.249657 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dcad080-a3cf-4335-a713-2235446255ed tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:02.250292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dcad080-a3cf-4335-a713-2235446255ed tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:02.250869 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4dcad080-a3cf-4335-a713-2235446255ed tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:02.424310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-4dcad080-a3cf-4335-a713-2235446255ed tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:02.433241 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4dcad080-a3cf-4335-a713-2235446255ed tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.207918 Aug 10 23:26:02.434401 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 476/958] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:02 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:03.618441 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-abb1a878-c244-4c7a-8fb1-ac8890e9d413 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:03.618441 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-abb1a878-c244-4c7a-8fb1-ac8890e9d413 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:03.618441 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abb1a878-c244-4c7a-8fb1-ac8890e9d413 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:03.618441 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abb1a878-c244-4c7a-8fb1-ac8890e9d413 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:03.619153 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abb1a878-c244-4c7a-8fb1-ac8890e9d413 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:03.619153 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abb1a878-c244-4c7a-8fb1-ac8890e9d413 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:03.619153 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abb1a878-c244-4c7a-8fb1-ac8890e9d413 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:03.619153 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-abb1a878-c244-4c7a-8fb1-ac8890e9d413 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:03.619453 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-abb1a878-c244-4c7a-8fb1-ac8890e9d413 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:03.622839 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-abb1a878-c244-4c7a-8fb1-ac8890e9d413 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.171837 Aug 10 23:26:03.623420 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 483/959] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:03 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:04.644584 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-120da5b7-644a-480f-bb89-9de9192d273e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:04.645326 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-120da5b7-644a-480f-bb89-9de9192d273e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:04.651814 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-120da5b7-644a-480f-bb89-9de9192d273e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:04.652306 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-120da5b7-644a-480f-bb89-9de9192d273e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:04.652748 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-120da5b7-644a-480f-bb89-9de9192d273e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:04.653467 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-120da5b7-644a-480f-bb89-9de9192d273e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:04.653928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-120da5b7-644a-480f-bb89-9de9192d273e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:04.654361 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-120da5b7-644a-480f-bb89-9de9192d273e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:05.062773 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-120da5b7-644a-480f-bb89-9de9192d273e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:05.070374 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-120da5b7-644a-480f-bb89-9de9192d273e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.430155 Aug 10 23:26:05.070986 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 477/960] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:04 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:06.092158 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ad49fa08-04d0-4e7a-8902-7631ca6ada60 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:06.092785 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ad49fa08-04d0-4e7a-8902-7631ca6ada60 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:06.099220 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad49fa08-04d0-4e7a-8902-7631ca6ada60 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:06.099700 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad49fa08-04d0-4e7a-8902-7631ca6ada60 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:06.100132 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad49fa08-04d0-4e7a-8902-7631ca6ada60 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:06.101002 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad49fa08-04d0-4e7a-8902-7631ca6ada60 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:06.101526 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad49fa08-04d0-4e7a-8902-7631ca6ada60 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:06.101952 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ad49fa08-04d0-4e7a-8902-7631ca6ada60 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:06.236093 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ad49fa08-04d0-4e7a-8902-7631ca6ada60 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:06.244895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ad49fa08-04d0-4e7a-8902-7631ca6ada60 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.156564 Aug 10 23:26:06.245466 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 484/961] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:06 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:07.265640 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dc60c944-eabd-4664-9302-f443ed66bb22 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:07.266217 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dc60c944-eabd-4664-9302-f443ed66bb22 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:07.273187 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc60c944-eabd-4664-9302-f443ed66bb22 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:07.275673 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc60c944-eabd-4664-9302-f443ed66bb22 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:07.275673 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc60c944-eabd-4664-9302-f443ed66bb22 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:07.275673 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc60c944-eabd-4664-9302-f443ed66bb22 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:07.275673 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc60c944-eabd-4664-9302-f443ed66bb22 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:07.276082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dc60c944-eabd-4664-9302-f443ed66bb22 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:07.413081 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-dc60c944-eabd-4664-9302-f443ed66bb22 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:07.420807 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dc60c944-eabd-4664-9302-f443ed66bb22 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.159029 Aug 10 23:26:07.421632 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 478/962] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:07 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:08.441359 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0f444627-99f0-4416-8fb9-98d2daf6f754 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:08.441974 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0f444627-99f0-4416-8fb9-98d2daf6f754 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:08.448932 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f444627-99f0-4416-8fb9-98d2daf6f754 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:08.449300 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f444627-99f0-4416-8fb9-98d2daf6f754 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:08.449738 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f444627-99f0-4416-8fb9-98d2daf6f754 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:08.450452 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f444627-99f0-4416-8fb9-98d2daf6f754 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:08.450930 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f444627-99f0-4416-8fb9-98d2daf6f754 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:08.451361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f444627-99f0-4416-8fb9-98d2daf6f754 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:08.590528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0f444627-99f0-4416-8fb9-98d2daf6f754 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:08.601108 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0f444627-99f0-4416-8fb9-98d2daf6f754 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.163519 Aug 10 23:26:08.601900 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 485/963] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:08 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:09.621685 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a1c1cc30-227e-46b3-9e98-1d8d06ade849 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:09.622798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a1c1cc30-227e-46b3-9e98-1d8d06ade849 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:09.624833 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:09.630407 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1c1cc30-227e-46b3-9e98-1d8d06ade849 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:09.632958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1c1cc30-227e-46b3-9e98-1d8d06ade849 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:09.632958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1c1cc30-227e-46b3-9e98-1d8d06ade849 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:09.632958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1c1cc30-227e-46b3-9e98-1d8d06ade849 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:09.632958 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1c1cc30-227e-46b3-9e98-1d8d06ade849 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:09.633371 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a1c1cc30-227e-46b3-9e98-1d8d06ade849 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:09.766322 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a1c1cc30-227e-46b3-9e98-1d8d06ade849 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:09.773985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a1c1cc30-227e-46b3-9e98-1d8d06ade849 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.156346 Aug 10 23:26:09.774774 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 479/964] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:09 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:10.795374 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6456e1ca-bd29-41d2-998f-63cc15ca7ca9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:10.796180 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6456e1ca-bd29-41d2-998f-63cc15ca7ca9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:10.798178 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=6 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:10.804648 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6456e1ca-bd29-41d2-998f-63cc15ca7ca9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:10.805139 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6456e1ca-bd29-41d2-998f-63cc15ca7ca9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:10.805612 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6456e1ca-bd29-41d2-998f-63cc15ca7ca9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:10.806534 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6456e1ca-bd29-41d2-998f-63cc15ca7ca9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:10.807012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6456e1ca-bd29-41d2-998f-63cc15ca7ca9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:10.814081 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6456e1ca-bd29-41d2-998f-63cc15ca7ca9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:10.944743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6456e1ca-bd29-41d2-998f-63cc15ca7ca9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:10.954465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6456e1ca-bd29-41d2-998f-63cc15ca7ca9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.163141 Aug 10 23:26:10.955062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 486/965] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:10 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:11.980599 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0b0f5cab-def7-42bb-84c8-20ab6e371380 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:11.980599 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0b0f5cab-def7-42bb-84c8-20ab6e371380 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:11.980599 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=8 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:11.985577 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0b0f5cab-def7-42bb-84c8-20ab6e371380 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:11.986177 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0b0f5cab-def7-42bb-84c8-20ab6e371380 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:11.986623 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0b0f5cab-def7-42bb-84c8-20ab6e371380 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:11.987408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0b0f5cab-def7-42bb-84c8-20ab6e371380 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:11.987859 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0b0f5cab-def7-42bb-84c8-20ab6e371380 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:11.988283 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0b0f5cab-def7-42bb-84c8-20ab6e371380 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:11.993577 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=69 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:12.204161 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0b0f5cab-def7-42bb-84c8-20ab6e371380 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:12.212337 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0b0f5cab-def7-42bb-84c8-20ab6e371380 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.240654 Aug 10 23:26:12.212914 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 480/966] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:11 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:12.770066 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-1925189a-a571-4172-8cd6-f97ab9fba090 req-54d8bfb9-2713-439d-81fb-b8371ae26f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accccf1a-80e8-4e9e-b0fc-088c611c496e", "tag": "68ea7c6e-43f1-4455-b812-68829f94092e"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:12.780033 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-1925189a-a571-4172-8cd6-f97ab9fba090 req-54d8bfb9-2713-439d-81fb-b8371ae26f1d service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:12.780518 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-1925189a-a571-4172-8cd6-f97ab9fba090 req-54d8bfb9-2713-439d-81fb-b8371ae26f1d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:12.780955 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-1925189a-a571-4172-8cd6-f97ab9fba090 req-54d8bfb9-2713-439d-81fb-b8371ae26f1d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:12.792176 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-1925189a-a571-4172-8cd6-f97ab9fba090 req-54d8bfb9-2713-439d-81fb-b8371ae26f1d service nova] Creating event network-changed:68ea7c6e-43f1-4455-b812-68829f94092e for instance accccf1a-80e8-4e9e-b0fc-088c611c496e on hv-cinder-85144 Aug 10 23:26:12.797097 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-1925189a-a571-4172-8cd6-f97ab9fba090 req-54d8bfb9-2713-439d-81fb-b8371ae26f1d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030667 Aug 10 23:26:12.797702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 487/967] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:13.232514 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5894a8ae-68a1-43cd-8b68-0aaff7e878d2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:13.233075 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5894a8ae-68a1-43cd-8b68-0aaff7e878d2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:13.240227 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5894a8ae-68a1-43cd-8b68-0aaff7e878d2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:13.240715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5894a8ae-68a1-43cd-8b68-0aaff7e878d2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:13.241158 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5894a8ae-68a1-43cd-8b68-0aaff7e878d2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:13.241861 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5894a8ae-68a1-43cd-8b68-0aaff7e878d2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:13.242321 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5894a8ae-68a1-43cd-8b68-0aaff7e878d2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:13.242781 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-5894a8ae-68a1-43cd-8b68-0aaff7e878d2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:13.370597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5894a8ae-68a1-43cd-8b68-0aaff7e878d2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:13.378047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5894a8ae-68a1-43cd-8b68-0aaff7e878d2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.149865 Aug 10 23:26:13.378611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 481/968] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:13 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:14.399563 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-42ca3ab8-b523-4cfb-8fc7-890021c0053b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:14.400267 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-42ca3ab8-b523-4cfb-8fc7-890021c0053b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:14.406452 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-42ca3ab8-b523-4cfb-8fc7-890021c0053b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:14.406968 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-42ca3ab8-b523-4cfb-8fc7-890021c0053b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:14.407413 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-42ca3ab8-b523-4cfb-8fc7-890021c0053b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:14.408111 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-42ca3ab8-b523-4cfb-8fc7-890021c0053b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:14.408569 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-42ca3ab8-b523-4cfb-8fc7-890021c0053b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:14.409002 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-42ca3ab8-b523-4cfb-8fc7-890021c0053b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:14.549518 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-42ca3ab8-b523-4cfb-8fc7-890021c0053b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:14.558248 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-42ca3ab8-b523-4cfb-8fc7-890021c0053b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.163425 Aug 10 23:26:14.559327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 488/969] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:14 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:15.578800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-83ee85bb-fb43-4401-af63-5a852b2f5bba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:15.579423 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-83ee85bb-fb43-4401-af63-5a852b2f5bba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:15.586065 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83ee85bb-fb43-4401-af63-5a852b2f5bba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:15.586551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83ee85bb-fb43-4401-af63-5a852b2f5bba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:15.587031 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83ee85bb-fb43-4401-af63-5a852b2f5bba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:15.587742 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83ee85bb-fb43-4401-af63-5a852b2f5bba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:15.588237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83ee85bb-fb43-4401-af63-5a852b2f5bba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:15.588673 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-83ee85bb-fb43-4401-af63-5a852b2f5bba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:15.719200 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-83ee85bb-fb43-4401-af63-5a852b2f5bba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:15.727013 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-83ee85bb-fb43-4401-af63-5a852b2f5bba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.152103 Aug 10 23:26:15.727583 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 482/970] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:15 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:16.748709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e559b391-888a-416c-8947-ae6c5bba0a27 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:16.749270 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e559b391-888a-416c-8947-ae6c5bba0a27 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:16.755729 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e559b391-888a-416c-8947-ae6c5bba0a27 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:16.756216 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e559b391-888a-416c-8947-ae6c5bba0a27 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:16.756655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e559b391-888a-416c-8947-ae6c5bba0a27 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:16.757986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e559b391-888a-416c-8947-ae6c5bba0a27 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:16.758442 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e559b391-888a-416c-8947-ae6c5bba0a27 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:16.758907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e559b391-888a-416c-8947-ae6c5bba0a27 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:16.885498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e559b391-888a-416c-8947-ae6c5bba0a27 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:16.892894 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e559b391-888a-416c-8947-ae6c5bba0a27 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.148181 Aug 10 23:26:16.893461 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 489/971] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:16 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:17.912782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e4fd6c97-ca50-47cc-a886-66a7703340e8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:17.913404 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e4fd6c97-ca50-47cc-a886-66a7703340e8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:17.919923 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fd6c97-ca50-47cc-a886-66a7703340e8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:17.920406 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fd6c97-ca50-47cc-a886-66a7703340e8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:17.920846 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fd6c97-ca50-47cc-a886-66a7703340e8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:17.921549 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fd6c97-ca50-47cc-a886-66a7703340e8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:17.922006 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fd6c97-ca50-47cc-a886-66a7703340e8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:17.922436 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e4fd6c97-ca50-47cc-a886-66a7703340e8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:18.048830 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e4fd6c97-ca50-47cc-a886-66a7703340e8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:18.056129 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e4fd6c97-ca50-47cc-a886-66a7703340e8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.147278 Aug 10 23:26:18.056687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 483/972] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:17 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:19.077943 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f5c9e945-abdc-4bc1-b8dc-0fc3b4091082 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:19.078569 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f5c9e945-abdc-4bc1-b8dc-0fc3b4091082 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:19.086003 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5c9e945-abdc-4bc1-b8dc-0fc3b4091082 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:19.086488 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5c9e945-abdc-4bc1-b8dc-0fc3b4091082 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:19.086954 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5c9e945-abdc-4bc1-b8dc-0fc3b4091082 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:19.087665 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5c9e945-abdc-4bc1-b8dc-0fc3b4091082 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:19.088117 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5c9e945-abdc-4bc1-b8dc-0fc3b4091082 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:19.088546 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5c9e945-abdc-4bc1-b8dc-0fc3b4091082 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:19.219158 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f5c9e945-abdc-4bc1-b8dc-0fc3b4091082 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:19.227599 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f5c9e945-abdc-4bc1-b8dc-0fc3b4091082 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.154677 Aug 10 23:26:19.228174 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 490/973] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:19 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:20.248523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f5094ae1-3705-4b56-8838-4b85585e9936 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:20.249173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f5094ae1-3705-4b56-8838-4b85585e9936 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:20.251687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:20.256372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5094ae1-3705-4b56-8838-4b85585e9936 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:20.256857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5094ae1-3705-4b56-8838-4b85585e9936 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:20.257315 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5094ae1-3705-4b56-8838-4b85585e9936 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:20.257999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5094ae1-3705-4b56-8838-4b85585e9936 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:20.258455 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5094ae1-3705-4b56-8838-4b85585e9936 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:20.258984 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5094ae1-3705-4b56-8838-4b85585e9936 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:20.402696 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f5094ae1-3705-4b56-8838-4b85585e9936 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:20.410084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f5094ae1-3705-4b56-8838-4b85585e9936 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.165476 Aug 10 23:26:20.410650 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 484/974] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:20 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:20.611604 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-a577ec24-4528-49a1-a190-07d4fa290229 req-ba6628b0-2cdc-40dc-88e5-16e7c496c9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accccf1a-80e8-4e9e-b0fc-088c611c496e", "name": "network-vif-plugged", "status": "completed", "tag": "68ea7c6e-43f1-4455-b812-68829f94092e"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:20.619921 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a577ec24-4528-49a1-a190-07d4fa290229 req-ba6628b0-2cdc-40dc-88e5-16e7c496c9a0 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:20.620404 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a577ec24-4528-49a1-a190-07d4fa290229 req-ba6628b0-2cdc-40dc-88e5-16e7c496c9a0 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:20.620839 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a577ec24-4528-49a1-a190-07d4fa290229 req-ba6628b0-2cdc-40dc-88e5-16e7c496c9a0 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:20.632989 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-a577ec24-4528-49a1-a190-07d4fa290229 req-ba6628b0-2cdc-40dc-88e5-16e7c496c9a0 service nova] Creating event network-vif-plugged:68ea7c6e-43f1-4455-b812-68829f94092e for instance accccf1a-80e8-4e9e-b0fc-088c611c496e on hv-cinder-85144 Aug 10 23:26:20.639140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-a577ec24-4528-49a1-a190-07d4fa290229 req-ba6628b0-2cdc-40dc-88e5-16e7c496c9a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032594 Aug 10 23:26:20.640263 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 491/975] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:21.432143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-89ab3404-a77d-489b-a14f-d65b62ffb5c9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:21.432918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-89ab3404-a77d-489b-a14f-d65b62ffb5c9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:21.439367 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89ab3404-a77d-489b-a14f-d65b62ffb5c9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:21.439849 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89ab3404-a77d-489b-a14f-d65b62ffb5c9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:21.440288 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89ab3404-a77d-489b-a14f-d65b62ffb5c9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:21.440994 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89ab3404-a77d-489b-a14f-d65b62ffb5c9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:21.441479 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89ab3404-a77d-489b-a14f-d65b62ffb5c9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:21.441905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89ab3404-a77d-489b-a14f-d65b62ffb5c9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:21.569875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-89ab3404-a77d-489b-a14f-d65b62ffb5c9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:21.577186 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-89ab3404-a77d-489b-a14f-d65b62ffb5c9 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.149452 Aug 10 23:26:21.577748 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 485/976] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:21 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:22.598709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-504ae313-054f-463e-a956-357b28e9a7fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:22.599448 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-504ae313-054f-463e-a956-357b28e9a7fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:22.601385 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:22.606788 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-504ae313-054f-463e-a956-357b28e9a7fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:22.607272 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-504ae313-054f-463e-a956-357b28e9a7fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:22.607735 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-504ae313-054f-463e-a956-357b28e9a7fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:22.608439 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-504ae313-054f-463e-a956-357b28e9a7fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:22.608890 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-504ae313-054f-463e-a956-357b28e9a7fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:22.609321 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-504ae313-054f-463e-a956-357b28e9a7fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:22.744817 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-504ae313-054f-463e-a956-357b28e9a7fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:22.752363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-504ae313-054f-463e-a956-357b28e9a7fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1356 microversion: 2.1 time: 0.158653 Aug 10 23:26:22.752915 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 492/977] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:22 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:23.774432 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3e488747-eede-47b8-9aee-49c93ce0f6d7 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:23.775019 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3e488747-eede-47b8-9aee-49c93ce0f6d7 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:23.781343 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e488747-eede-47b8-9aee-49c93ce0f6d7 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:23.781824 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e488747-eede-47b8-9aee-49c93ce0f6d7 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:23.782253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e488747-eede-47b8-9aee-49c93ce0f6d7 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:23.783107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e488747-eede-47b8-9aee-49c93ce0f6d7 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:23.783562 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e488747-eede-47b8-9aee-49c93ce0f6d7 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:23.783988 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3e488747-eede-47b8-9aee-49c93ce0f6d7 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:23.909861 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3e488747-eede-47b8-9aee-49c93ce0f6d7 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:23.917280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3e488747-eede-47b8-9aee-49c93ce0f6d7 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1547 microversion: 2.1 time: 0.147311 Aug 10 23:26:23.917846 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 486/978] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:23 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:23.937021 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3f537231-f055-43da-b86e-44dfd08340fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:23.937630 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3f537231-f055-43da-b86e-44dfd08340fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:23.943924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f537231-f055-43da-b86e-44dfd08340fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:23.944932 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f537231-f055-43da-b86e-44dfd08340fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:23.945366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f537231-f055-43da-b86e-44dfd08340fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:23.946049 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f537231-f055-43da-b86e-44dfd08340fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:23.946495 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f537231-f055-43da-b86e-44dfd08340fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:23.946945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3f537231-f055-43da-b86e-44dfd08340fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:23.950870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=84 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:24.072839 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3f537231-f055-43da-b86e-44dfd08340fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:24.080251 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3f537231-f055-43da-b86e-44dfd08340fc tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1547 microversion: 2.1 time: 0.147029 Aug 10 23:26:24.080824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 493/979] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:23 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:24.100394 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:24.105201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:24.105967 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Searching by: {'deleted': False, 'project_id': '1fbc9fef5e46490da9e1142d70e04228'} {{(pid=121333) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:26:24.112537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:24.113024 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:24.113459 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:24.114187 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:24.114644 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:24.115092 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:24.205999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.multi_cell_list [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121333) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:26:24.296634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9c5918aa-cede-480e-b35b-8f1fe7d335ec tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.199886 Aug 10 23:26:24.297135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 487/980] 10.222.0.78 () {58 vars in 1125 bytes} [Wed Aug 10 23:26:24 2022] GET /compute/v2.1/servers => generated 341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:24.308819 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7e93509b-b7cb-4f77-9549-f1686c806997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:24.309446 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7e93509b-b7cb-4f77-9549-f1686c806997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:24.315357 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e93509b-b7cb-4f77-9549-f1686c806997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:24.315838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e93509b-b7cb-4f77-9549-f1686c806997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:24.316274 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e93509b-b7cb-4f77-9549-f1686c806997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:24.316970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e93509b-b7cb-4f77-9549-f1686c806997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:24.317424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e93509b-b7cb-4f77-9549-f1686c806997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:24.317854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e93509b-b7cb-4f77-9549-f1686c806997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:24.457609 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7e93509b-b7cb-4f77-9549-f1686c806997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:24.465473 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7e93509b-b7cb-4f77-9549-f1686c806997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1547 microversion: 2.1 time: 0.160467 Aug 10 23:26:24.466047 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 494/981] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:24 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:26.432923 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-18d7be6b-ca16-44eb-bd58-6a214032c2ef tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:26.435283 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-18d7be6b-ca16-44eb-bd58-6a214032c2ef tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:26.441689 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18d7be6b-ca16-44eb-bd58-6a214032c2ef tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:26.442173 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18d7be6b-ca16-44eb-bd58-6a214032c2ef tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:26.442610 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18d7be6b-ca16-44eb-bd58-6a214032c2ef tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:26.443333 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18d7be6b-ca16-44eb-bd58-6a214032c2ef tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:26.443791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18d7be6b-ca16-44eb-bd58-6a214032c2ef tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:26.444218 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-18d7be6b-ca16-44eb-bd58-6a214032c2ef tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:27.143450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-18d7be6b-ca16-44eb-bd58-6a214032c2ef tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "POST /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714647 Aug 10 23:26:27.144078 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 488/982] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:26:26 2022] POST /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments => generated 194 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:34.719680 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-040f3b6d-4d46-44a7-8a29-4913753a0ef8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:34.720297 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-040f3b6d-4d46-44a7-8a29-4913753a0ef8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:34.722322 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=5 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:34.723115 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=11 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:34.728582 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-040f3b6d-4d46-44a7-8a29-4913753a0ef8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:34.735424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-040f3b6d-4d46-44a7-8a29-4913753a0ef8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:34.735424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-040f3b6d-4d46-44a7-8a29-4913753a0ef8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:34.735424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-040f3b6d-4d46-44a7-8a29-4913753a0ef8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:34.735424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-040f3b6d-4d46-44a7-8a29-4913753a0ef8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:34.735806 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-040f3b6d-4d46-44a7-8a29-4913753a0ef8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:34.857396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-040f3b6d-4d46-44a7-8a29-4913753a0ef8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:34.865237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-040f3b6d-4d46-44a7-8a29-4913753a0ef8 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1593 microversion: 2.1 time: 0.149504 Aug 10 23:26:34.865798 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 495/983] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:34 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:36.813712 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-9589aa28-6f5f-4212-b761-fb570073c77b req-66d5e04d-d85a-48d9-9447-0662315b3396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accccf1a-80e8-4e9e-b0fc-088c611c496e", "tag": "68ea7c6e-43f1-4455-b812-68829f94092e"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:36.819408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:36.821544 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=9 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:36.826854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-9589aa28-6f5f-4212-b761-fb570073c77b req-66d5e04d-d85a-48d9-9447-0662315b3396 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:36.827429 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-9589aa28-6f5f-4212-b761-fb570073c77b req-66d5e04d-d85a-48d9-9447-0662315b3396 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:36.828083 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-9589aa28-6f5f-4212-b761-fb570073c77b req-66d5e04d-d85a-48d9-9447-0662315b3396 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:36.841863 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-9589aa28-6f5f-4212-b761-fb570073c77b req-66d5e04d-d85a-48d9-9447-0662315b3396 service nova] Creating event network-changed:68ea7c6e-43f1-4455-b812-68829f94092e for instance accccf1a-80e8-4e9e-b0fc-088c611c496e on hv-cinder-85144 Aug 10 23:26:36.847313 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-9589aa28-6f5f-4212-b761-fb570073c77b req-66d5e04d-d85a-48d9-9447-0662315b3396 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037498 Aug 10 23:26:36.847955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 489/984] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:39.194247 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-172fb2f0-bc89-44b5-b8e8-2fb4175aa15b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2078570890"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:39.194825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-172fb2f0-bc89-44b5-b8e8-2fb4175aa15b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:39.200950 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-172fb2f0-bc89-44b5-b8e8-2fb4175aa15b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:39.201430 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-172fb2f0-bc89-44b5-b8e8-2fb4175aa15b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:39.201884 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-172fb2f0-bc89-44b5-b8e8-2fb4175aa15b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:39.202621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-172fb2f0-bc89-44b5-b8e8-2fb4175aa15b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:39.203101 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-172fb2f0-bc89-44b5-b8e8-2fb4175aa15b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:39.203527 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-172fb2f0-bc89-44b5-b8e8-2fb4175aa15b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:39.329321 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.network.security_group_api [None req-172fb2f0-bc89-44b5-b8e8-2fb4175aa15b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Adding security group cf83060d-2d00-4514-a764-2c66ef44f363 to port 68ea7c6e-43f1-4455-b812-68829f94092e Aug 10 23:26:39.718821 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-172fb2f0-bc89-44b5-b8e8-2fb4175aa15b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "POST /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/action" status: 202 len: 0 microversion: 2.1 time: 0.528469 Aug 10 23:26:39.729427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 496/985] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:26:39 2022] POST /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:26:39.729427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-abe73828-c072-4ccd-ada3-f3d968a82227 req-6dc46aac-a91c-4251-b1eb-0fc243c19a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accccf1a-80e8-4e9e-b0fc-088c611c496e", "tag": "68ea7c6e-43f1-4455-b812-68829f94092e"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:39.729745 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2134404d-35a6-4ecc-8b92-85c5341b1104 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:39.729745 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2134404d-35a6-4ecc-8b92-85c5341b1104 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:39.736851 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2134404d-35a6-4ecc-8b92-85c5341b1104 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:39.737551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2134404d-35a6-4ecc-8b92-85c5341b1104 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:39.738196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2134404d-35a6-4ecc-8b92-85c5341b1104 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:39.738938 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2134404d-35a6-4ecc-8b92-85c5341b1104 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:39.739197 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-abe73828-c072-4ccd-ada3-f3d968a82227 req-6dc46aac-a91c-4251-b1eb-0fc243c19a0d service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:39.739411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2134404d-35a6-4ecc-8b92-85c5341b1104 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:39.739680 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-abe73828-c072-4ccd-ada3-f3d968a82227 req-6dc46aac-a91c-4251-b1eb-0fc243c19a0d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:39.739831 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2134404d-35a6-4ecc-8b92-85c5341b1104 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:39.740113 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-abe73828-c072-4ccd-ada3-f3d968a82227 req-6dc46aac-a91c-4251-b1eb-0fc243c19a0d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:39.752602 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-abe73828-c072-4ccd-ada3-f3d968a82227 req-6dc46aac-a91c-4251-b1eb-0fc243c19a0d service nova] Creating event network-changed:68ea7c6e-43f1-4455-b812-68829f94092e for instance accccf1a-80e8-4e9e-b0fc-088c611c496e on hv-cinder-85144 Aug 10 23:26:39.758465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-abe73828-c072-4ccd-ada3-f3d968a82227 req-6dc46aac-a91c-4251-b1eb-0fc243c19a0d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033031 Aug 10 23:26:39.759495 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 497/986] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:26:40.011296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2134404d-35a6-4ecc-8b92-85c5341b1104 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:40.020099 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2134404d-35a6-4ecc-8b92-85c5341b1104 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1759 microversion: 2.1 time: 0.295927 Aug 10 23:26:40.031247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 490/987] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:26:39 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1759 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:26:58.261025 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4dcc2d61-2fa3-48a5-aec8-35da33acb909 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:58.261586 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4dcc2d61-2fa3-48a5-aec8-35da33acb909 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:58.264692 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=6 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:58.265456 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=12 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:58.270238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4dcc2d61-2fa3-48a5-aec8-35da33acb909 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:58.271008 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4dcc2d61-2fa3-48a5-aec8-35da33acb909 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:58.271371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4dcc2d61-2fa3-48a5-aec8-35da33acb909 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:58.272065 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4dcc2d61-2fa3-48a5-aec8-35da33acb909 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:58.272521 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4dcc2d61-2fa3-48a5-aec8-35da33acb909 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:58.272947 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4dcc2d61-2fa3-48a5-aec8-35da33acb909 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:58.297812 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4dcc2d61-2fa3-48a5-aec8-35da33acb909 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/ips" status: 200 len: 147 microversion: 2.1 time: 0.041082 Aug 10 23:26:58.298373 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 498/988] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 10 23:26:58 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:00.012327 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fdf98687-b329-4a89-a566-79deae6c76f0 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e0c97f1-aa19-4064-9039-9bef008c94be"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:00.015311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-fdf98687-b329-4a89-a566-79deae6c76f0 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:00.017784 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=4 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:00.018461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:00.023149 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fdf98687-b329-4a89-a566-79deae6c76f0 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:00.025759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fdf98687-b329-4a89-a566-79deae6c76f0 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:00.025759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fdf98687-b329-4a89-a566-79deae6c76f0 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:00.025759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fdf98687-b329-4a89-a566-79deae6c76f0 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:00.025759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fdf98687-b329-4a89-a566-79deae6c76f0 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:00.026147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fdf98687-b329-4a89-a566-79deae6c76f0 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:00.821849 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-fdf98687-b329-4a89-a566-79deae6c76f0 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.813247 Aug 10 23:27:00.822597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 491/989] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:27:00 2022] POST /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:08.344584 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-399b21d8-f2bd-40ae-9dfc-7ac1e0233d17 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:08.347304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-399b21d8-f2bd-40ae-9dfc-7ac1e0233d17 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:08.354083 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-399b21d8-f2bd-40ae-9dfc-7ac1e0233d17 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:08.354566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-399b21d8-f2bd-40ae-9dfc-7ac1e0233d17 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:08.355032 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-399b21d8-f2bd-40ae-9dfc-7ac1e0233d17 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:08.355733 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-399b21d8-f2bd-40ae-9dfc-7ac1e0233d17 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:08.356194 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-399b21d8-f2bd-40ae-9dfc-7ac1e0233d17 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:08.356626 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-399b21d8-f2bd-40ae-9dfc-7ac1e0233d17 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:08.384562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-399b21d8-f2bd-40ae-9dfc-7ac1e0233d17 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Aug 10 23:27:08.385111 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 499/990] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:27:08 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:08.397227 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0f52ad67-79da-41e3-95ca-7f6893da84ab tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:08.397774 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0f52ad67-79da-41e3-95ca-7f6893da84ab tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:08.404027 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0f52ad67-79da-41e3-95ca-7f6893da84ab tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:08.404502 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0f52ad67-79da-41e3-95ca-7f6893da84ab tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:08.404935 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0f52ad67-79da-41e3-95ca-7f6893da84ab tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:08.405614 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0f52ad67-79da-41e3-95ca-7f6893da84ab tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:08.406060 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0f52ad67-79da-41e3-95ca-7f6893da84ab tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:08.406478 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0f52ad67-79da-41e3-95ca-7f6893da84ab tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:08.441059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0f52ad67-79da-41e3-95ca-7f6893da84ab tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments/3e0c97f1-aa19-4064-9039-9bef008c94be" status: 200 len: 194 microversion: 2.1 time: 0.049155 Aug 10 23:27:08.441678 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 492/991] 10.222.0.78 () {58 vars in 1413 bytes} [Wed Aug 10 23:27:08 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments/3e0c97f1-aa19-4064-9039-9bef008c94be => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:10.042687 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cdf4afef-3928-43a4-9e22-410cb5c60de4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4d251d5-f91e-4183-aee5-701eaab6bf76"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:10.045032 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cdf4afef-3928-43a4-9e22-410cb5c60de4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:10.051436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdf4afef-3928-43a4-9e22-410cb5c60de4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:10.051945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdf4afef-3928-43a4-9e22-410cb5c60de4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:10.052387 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdf4afef-3928-43a4-9e22-410cb5c60de4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:10.053115 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdf4afef-3928-43a4-9e22-410cb5c60de4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:10.053572 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdf4afef-3928-43a4-9e22-410cb5c60de4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:10.054003 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cdf4afef-3928-43a4-9e22-410cb5c60de4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:10.862815 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cdf4afef-3928-43a4-9e22-410cb5c60de4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "POST /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.824103 Aug 10 23:27:10.863475 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 500/992] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:27:10 2022] POST /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments => generated 194 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:19.434601 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e07c92ab-e5a3-4979-9adf-24e7767e0270 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:19.436945 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e07c92ab-e5a3-4979-9adf-24e7767e0270 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:19.440096 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=4 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:19.441804 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:19.445416 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e07c92ab-e5a3-4979-9adf-24e7767e0270 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:19.445903 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e07c92ab-e5a3-4979-9adf-24e7767e0270 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:19.446352 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e07c92ab-e5a3-4979-9adf-24e7767e0270 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:19.447094 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e07c92ab-e5a3-4979-9adf-24e7767e0270 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:19.447552 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e07c92ab-e5a3-4979-9adf-24e7767e0270 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:19.447984 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e07c92ab-e5a3-4979-9adf-24e7767e0270 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:19.486172 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e07c92ab-e5a3-4979-9adf-24e7767e0270 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055488 Aug 10 23:27:19.486759 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 493/993] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:27:19 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:27:19.626733 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0f2c1b96-f57b-41cd-80bb-ae76c846a37e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:19.627268 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0f2c1b96-f57b-41cd-80bb-ae76c846a37e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:19.633464 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f2c1b96-f57b-41cd-80bb-ae76c846a37e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:19.633950 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f2c1b96-f57b-41cd-80bb-ae76c846a37e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:19.634391 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f2c1b96-f57b-41cd-80bb-ae76c846a37e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:19.635119 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f2c1b96-f57b-41cd-80bb-ae76c846a37e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:19.635611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f2c1b96-f57b-41cd-80bb-ae76c846a37e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:19.642449 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0f2c1b96-f57b-41cd-80bb-ae76c846a37e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:19.664000 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0f2c1b96-f57b-41cd-80bb-ae76c846a37e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments/3e0c97f1-aa19-4064-9039-9bef008c94be" status: 200 len: 194 microversion: 2.1 time: 0.042984 Aug 10 23:27:19.664581 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 501/994] 10.222.0.78 () {58 vars in 1413 bytes} [Wed Aug 10 23:27:19 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments/3e0c97f1-aa19-4064-9039-9bef008c94be => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:19.675322 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7e59b857-cd72-4970-812d-a1d05c506294 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:19.675820 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7e59b857-cd72-4970-812d-a1d05c506294 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:19.682961 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e59b857-cd72-4970-812d-a1d05c506294 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:19.683446 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e59b857-cd72-4970-812d-a1d05c506294 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:19.683882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e59b857-cd72-4970-812d-a1d05c506294 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:19.684576 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e59b857-cd72-4970-812d-a1d05c506294 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:19.685034 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e59b857-cd72-4970-812d-a1d05c506294 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:19.685460 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7e59b857-cd72-4970-812d-a1d05c506294 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:19.773814 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-7e59b857-cd72-4970-812d-a1d05c506294 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lazy-loading 'services' on Instance uuid cca161c9-6a61-4165-9b4d-3fed252d1aa7 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:27:20.017379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7e59b857-cd72-4970-812d-a1d05c506294 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments/3e0c97f1-aa19-4064-9039-9bef008c94be" status: 202 len: 0 microversion: 2.1 time: 0.346295 Aug 10 23:27:20.018210 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 494/995] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:27:19 2022] DELETE /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments/3e0c97f1-aa19-4064-9039-9bef008c94be => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:27:22.209614 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8affaf8d-666f-4566-b6f2-81981de5a397 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:22.210171 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8affaf8d-666f-4566-b6f2-81981de5a397 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:22.216574 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8affaf8d-666f-4566-b6f2-81981de5a397 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:22.217053 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8affaf8d-666f-4566-b6f2-81981de5a397 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:22.217490 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8affaf8d-666f-4566-b6f2-81981de5a397 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:22.218185 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8affaf8d-666f-4566-b6f2-81981de5a397 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:22.218634 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8affaf8d-666f-4566-b6f2-81981de5a397 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:22.219083 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8affaf8d-666f-4566-b6f2-81981de5a397 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:22.246966 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8affaf8d-666f-4566-b6f2-81981de5a397 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments/e4d251d5-f91e-4183-aee5-701eaab6bf76" status: 200 len: 194 microversion: 2.1 time: 0.042269 Aug 10 23:27:22.247532 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 502/996] 10.222.0.78 () {58 vars in 1413 bytes} [Wed Aug 10 23:27:22 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments/e4d251d5-f91e-4183-aee5-701eaab6bf76 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:22.258904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b6ee6dc5-e37e-4685-a522-4d0dc715e116 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:22.259488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b6ee6dc5-e37e-4685-a522-4d0dc715e116 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:22.266059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6ee6dc5-e37e-4685-a522-4d0dc715e116 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:22.266539 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6ee6dc5-e37e-4685-a522-4d0dc715e116 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:22.267005 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6ee6dc5-e37e-4685-a522-4d0dc715e116 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:22.267704 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6ee6dc5-e37e-4685-a522-4d0dc715e116 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:22.268159 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6ee6dc5-e37e-4685-a522-4d0dc715e116 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:22.268583 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b6ee6dc5-e37e-4685-a522-4d0dc715e116 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:22.349041 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-b6ee6dc5-e37e-4685-a522-4d0dc715e116 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lazy-loading 'services' on Instance uuid cca161c9-6a61-4165-9b4d-3fed252d1aa7 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:27:22.594588 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b6ee6dc5-e37e-4685-a522-4d0dc715e116 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments/e4d251d5-f91e-4183-aee5-701eaab6bf76" status: 202 len: 0 microversion: 2.1 time: 0.339651 Aug 10 23:27:22.595249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 495/997] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:27:22 2022] DELETE /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments/e4d251d5-f91e-4183-aee5-701eaab6bf76 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:27:23.765037 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a3ea9e3a-bec3-43a5-b640-95619e40eefa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:23.767438 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a3ea9e3a-bec3-43a5-b640-95619e40eefa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:23.774589 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3ea9e3a-bec3-43a5-b640-95619e40eefa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:23.775040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3ea9e3a-bec3-43a5-b640-95619e40eefa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:23.775476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3ea9e3a-bec3-43a5-b640-95619e40eefa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:23.776204 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3ea9e3a-bec3-43a5-b640-95619e40eefa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:23.776768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3ea9e3a-bec3-43a5-b640-95619e40eefa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:23.777213 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3ea9e3a-bec3-43a5-b640-95619e40eefa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:23.805164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a3ea9e3a-bec3-43a5-b640-95619e40eefa tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044960 Aug 10 23:27:23.805723 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 503/998] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:27:23 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:27:23.917253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-273066c9-8ff9-4a02-8dd6-cedc30625108 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:23.919707 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-273066c9-8ff9-4a02-8dd6-cedc30625108 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:23.927177 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-273066c9-8ff9-4a02-8dd6-cedc30625108 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:23.927660 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-273066c9-8ff9-4a02-8dd6-cedc30625108 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:23.928097 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-273066c9-8ff9-4a02-8dd6-cedc30625108 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:23.928789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-273066c9-8ff9-4a02-8dd6-cedc30625108 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:23.929240 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-273066c9-8ff9-4a02-8dd6-cedc30625108 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:23.929663 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-273066c9-8ff9-4a02-8dd6-cedc30625108 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:23.958256 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-273066c9-8ff9-4a02-8dd6-cedc30625108 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045456 Aug 10 23:27:23.958838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 496/999] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:27:23 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:27:24.018496 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a9a350f2-2ab5-4e40-9586-a699c4c03a06 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:24.019026 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a9a350f2-2ab5-4e40-9586-a699c4c03a06 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:24.024970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a9a350f2-2ab5-4e40-9586-a699c4c03a06 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:24.025388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a9a350f2-2ab5-4e40-9586-a699c4c03a06 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:24.025823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a9a350f2-2ab5-4e40-9586-a699c4c03a06 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:24.026507 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a9a350f2-2ab5-4e40-9586-a699c4c03a06 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:24.026996 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a9a350f2-2ab5-4e40-9586-a699c4c03a06 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:24.027419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a9a350f2-2ab5-4e40-9586-a699c4c03a06 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:24.051633 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a9a350f2-2ab5-4e40-9586-a699c4c03a06 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:27:24.349860 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a9a350f2-2ab5-4e40-9586-a699c4c03a06 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 204 len: 0 microversion: 2.1 time: 0.334817 Aug 10 23:27:24.350374 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 504/1000] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:27:24 2022] DELETE /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:27:24.358488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1769b8d0-4435-491b-963c-168330cb4da9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:24.359127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1769b8d0-4435-491b-963c-168330cb4da9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:24.365688 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1769b8d0-4435-491b-963c-168330cb4da9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:24.366221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1769b8d0-4435-491b-963c-168330cb4da9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:24.366675 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1769b8d0-4435-491b-963c-168330cb4da9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:24.367381 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1769b8d0-4435-491b-963c-168330cb4da9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:24.367837 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1769b8d0-4435-491b-963c-168330cb4da9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:24.368261 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1769b8d0-4435-491b-963c-168330cb4da9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:24.500577 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1769b8d0-4435-491b-963c-168330cb4da9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:24.508233 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1769b8d0-4435-491b-963c-168330cb4da9 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1676 microversion: 2.1 time: 0.153591 Aug 10 23:27:24.508795 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 497/1001] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:24 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:25.529903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-81e9061e-ae13-4e40-9608-d1f22289c2db tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:25.530609 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-81e9061e-ae13-4e40-9608-d1f22289c2db tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:25.537075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e9061e-ae13-4e40-9608-d1f22289c2db tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:25.537552 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e9061e-ae13-4e40-9608-d1f22289c2db tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:25.537982 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e9061e-ae13-4e40-9608-d1f22289c2db tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:25.538718 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e9061e-ae13-4e40-9608-d1f22289c2db tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:25.539171 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e9061e-ae13-4e40-9608-d1f22289c2db tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:25.539746 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e9061e-ae13-4e40-9608-d1f22289c2db tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:25.680512 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-81e9061e-ae13-4e40-9608-d1f22289c2db tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:25.686469 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-81e9061e-ae13-4e40-9608-d1f22289c2db tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1676 microversion: 2.1 time: 0.160858 Aug 10 23:27:25.687047 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 505/1002] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:25 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:26.708688 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fcedd77f-0343-4a9a-a033-e0a050960e9c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:26.709235 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-fcedd77f-0343-4a9a-a033-e0a050960e9c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:26.715575 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fcedd77f-0343-4a9a-a033-e0a050960e9c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:26.716059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fcedd77f-0343-4a9a-a033-e0a050960e9c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:26.716497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fcedd77f-0343-4a9a-a033-e0a050960e9c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:26.717192 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fcedd77f-0343-4a9a-a033-e0a050960e9c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:26.717654 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fcedd77f-0343-4a9a-a033-e0a050960e9c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:26.718080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fcedd77f-0343-4a9a-a033-e0a050960e9c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:26.953107 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-fcedd77f-0343-4a9a-a033-e0a050960e9c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:26.962246 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-fcedd77f-0343-4a9a-a033-e0a050960e9c tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1676 microversion: 2.1 time: 0.258263 Aug 10 23:27:26.962871 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 498/1003] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:26 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1676 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:27.141140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-a828a168-d161-43f4-b03c-cf57d595a275 req-25fb5d4f-0811-4d3d-9b02-5cbe26c612d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca161c9-6a61-4165-9b4d-3fed252d1aa7", "name": "network-vif-deleted", "tag": "ebd93707-0e2b-4d56-8e8c-441e4035a649"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:27.151329 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a828a168-d161-43f4-b03c-cf57d595a275 req-25fb5d4f-0811-4d3d-9b02-5cbe26c612d9 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:27.151903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a828a168-d161-43f4-b03c-cf57d595a275 req-25fb5d4f-0811-4d3d-9b02-5cbe26c612d9 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:27.152346 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-a828a168-d161-43f4-b03c-cf57d595a275 req-25fb5d4f-0811-4d3d-9b02-5cbe26c612d9 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:27.164248 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-a828a168-d161-43f4-b03c-cf57d595a275 req-25fb5d4f-0811-4d3d-9b02-5cbe26c612d9 service nova] Creating event network-vif-deleted:ebd93707-0e2b-4d56-8e8c-441e4035a649 for instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 on hv-cinder-85144 Aug 10 23:27:27.170050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-a828a168-d161-43f4-b03c-cf57d595a275 req-25fb5d4f-0811-4d3d-9b02-5cbe26c612d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032534 Aug 10 23:27:27.170681 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 506/1004] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:27.983463 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:27.984216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:27.990831 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:27.991533 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:27.992041 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:27.992748 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:27.993206 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:27.993636 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:28.025628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:28.026114 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:28.026559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:28.027035 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.objects.instance [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lazy-loading 'fault' on Instance uuid cca161c9-6a61-4165-9b4d-3fed252d1aa7 {{(pid=121333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:27:28.067983 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af5d49420a437193f2525bda7550d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72afdc971a44dd6a4eaabd40c40bbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:28.079076 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d49bb23c-1ed8-4e55-918e-2614fc69e6b4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 200 len: 1328 microversion: 2.1 time: 0.096093 Aug 10 23:27:28.079076 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 499/1005] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:27 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:29.098557 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:29.099321 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:29.106000 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:29.106483 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:29.106953 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:29.107654 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:29.108110 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:29.108542 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:29.123508 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] HTTP exception thrown: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Request method failure captured: Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 HTTP/1.1 Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D05e135eKtqlb537ipuj3GVo7oxhgqyC5JOY2K79MRmLAA5FYxNeQQVo-Mpe2dVXPlIPR7sFvD09yuD7TxZ1UJqXxf-RSG-_NfdM0vDaAvUOBkgble_fjKMBI2nUw3JtDk_as2biImmvLY0E-CioQZPbeVjQOdNY31Rk5_V2gfmNE8 Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:27:29.125114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e72afdc971a44dd6a4eaabd40c40bbcb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 35af5d49420a437193f2525bda7550d9 Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:29.126906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'cca161c9-6a61-4165-9b4d-3fed252d1aa7'} Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:27:29.127903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:29.129578 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:29.131230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Returning 404 to user: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:27:29.131230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f1e49ee2-20f6-4c3a-9083-a401da04368b tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 404 len: 111 microversion: 2.1 time: 0.032684 Aug 10 23:27:29.131230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 507/1006] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:29 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:27:29.135200 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-ffba76c0-fbe5-4441-bc1b-93d89f612b56 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '.version_select at 0x7fe84058f9d0>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:29.275655 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-ffba76c0-fbe5-4441-bc1b-93d89f612b56 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149015379" status: 202 len: 0 microversion: 2.1 time: 0.144127 Aug 10 23:27:29.276244 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 500/1007] 10.222.0.78 () {58 vars in 1221 bytes} [Wed Aug 10 23:27:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149015379 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:27:32.668815 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:32.669332 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:32.675949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:32.676484 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:32.676858 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:32.677541 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:32.677990 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:32.678410 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:32.692555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] HTTP exception thrown: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Request method failure captured: Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: DELETE /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 HTTP/1.1 Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D05e135eKtqlb537ipuj3GVo7oxhgqyC5JOY2K79MRmLAA5FYxNeQQVo-Mpe2dVXPlIPR7sFvD09yuD7TxZ1UJqXxf-RSG-_NfdM0vDaAvUOBkgble_fjKMBI2nUw3JtDk_as2biImmvLY0E-CioQZPbeVjQOdNY31Rk5_V2gfmNE8 Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:27:32.694098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e72afdc971a44dd6a4eaabd40c40bbcb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 35af5d49420a437193f2525bda7550d9 Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:32.695898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'cca161c9-6a61-4165-9b4d-3fed252d1aa7'} Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:27:32.696763 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:32.698054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:32.700243 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Returning 404 to user: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:27:32.700243 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2e274085-b0ae-4712-b421-35ce442b54ac tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 404 len: 111 microversion: 2.1 time: 0.030568 Aug 10 23:27:32.700243 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 508/1008] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:27:32 2022] DELETE /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:27:32.704642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:32.705260 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: cca161c9-6a61-4165-9b4d-3fed252d1aa7] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:32.712758 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:32.713238 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:32.713671 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:32.714356 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:32.714838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:32.715261 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:32.727890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] HTTP exception thrown: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Request method failure captured: Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 HTTP/1.1 Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D05e135eKtqlb537ipuj3GVo7oxhgqyC5JOY2K79MRmLAA5FYxNeQQVo-Mpe2dVXPlIPR7sFvD09yuD7TxZ1UJqXxf-RSG-_NfdM0vDaAvUOBkgble_fjKMBI2nUw3JtDk_as2biImmvLY0E-CioQZPbeVjQOdNY31Rk5_V2gfmNE8 Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:27:32.729551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e72afdc971a44dd6a4eaabd40c40bbcb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 35af5d49420a437193f2525bda7550d9 Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:32.731243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'cca161c9-6a61-4165-9b4d-3fed252d1aa7'} Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:27:32.732205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. Aug 10 23:27:32.733780 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:32.735342 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Returning 404 to user: Instance cca161c9-6a61-4165-9b4d-3fed252d1aa7 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:27:32.735342 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8a65fe4a-31ff-4400-881a-57eaf751cc57 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7" status: 404 len: 111 microversion: 2.1 time: 0.030764 Aug 10 23:27:32.735342 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 501/1009] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:32 2022] GET /compute/v2.1/servers/cca161c9-6a61-4165-9b4d-3fed252d1aa7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:27:34.034478 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:34.035050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:34.041482 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:34.041965 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:34.042404 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:34.043127 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:34.043590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:34.044059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:34.057399 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] HTTP exception thrown: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Request method failure captured: Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: DELETE /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 HTTP/1.1 Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D05e135eKtqlb537ipuj3GVo7oxhgqyC5JOY2K79MRmLAA5FYxNeQQVo-Mpe2dVXPlIPR7sFvD09yuD7TxZ1UJqXxf-RSG-_NfdM0vDaAvUOBkgble_fjKMBI2nUw3JtDk_as2biImmvLY0E-CioQZPbeVjQOdNY31Rk5_V2gfmNE8 Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:27:34.058993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e72afdc971a44dd6a4eaabd40c40bbcb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 35af5d49420a437193f2525bda7550d9 Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:27:34.060743 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'd6ed0bfa-e1e6-429e-b615-567dbbc217a9'} Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:27:34.061709 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:27:34.063366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:34.065069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Returning 404 to user: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:27:34.065069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-85b32986-edf1-4846-941b-a59af6058c8e tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 404 len: 111 microversion: 2.1 time: 0.029794 Aug 10 23:27:34.065069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 509/1010] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:27:34 2022] DELETE /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:27:34.071235 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:34.071885 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] [instance: d6ed0bfa-e1e6-429e-b615-567dbbc217a9] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:34.077903 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:34.078383 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:34.078847 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:34.079538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:34.079989 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:34.080410 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:34.094400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] HTTP exception thrown: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Request method failure captured: Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 HTTP/1.1 Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D05e135eKtqlb537ipuj3GVo7oxhgqyC5JOY2K79MRmLAA5FYxNeQQVo-Mpe2dVXPlIPR7sFvD09yuD7TxZ1UJqXxf-RSG-_NfdM0vDaAvUOBkgble_fjKMBI2nUw3JtDk_as2biImmvLY0E-CioQZPbeVjQOdNY31Rk5_V2gfmNE8 Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:27:34.095928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e72afdc971a44dd6a4eaabd40c40bbcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e72afdc971a44dd6a4eaabd40c40bbcb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: e72afdc971a44dd6a4eaabd40c40bbcb Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-AttachVolumeTestJSON-806995188 Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 35af5d49420a437193f2525bda7550d9 Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-AttachVolumeTestJSON-806995188-project Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:27:34.097687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'd6ed0bfa-e1e6-429e-b615-567dbbc217a9'} Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:27:34.098770 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. Aug 10 23:27:34.100359 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:34.101896 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] Returning 404 to user: Instance d6ed0bfa-e1e6-429e-b615-567dbbc217a9 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:27:34.101896 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7806af99-45f7-4184-89f0-74a6671d0bc4 tempest-AttachVolumeTestJSON-806995188 tempest-AttachVolumeTestJSON-806995188-project] 10.222.0.78 "GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9" status: 404 len: 111 microversion: 2.1 time: 0.032249 Aug 10 23:27:34.101896 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 502/1011] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:34 2022] GET /compute/v2.1/servers/d6ed0bfa-e1e6-429e-b615-567dbbc217a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:27:39.728211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1615496b-bb5d-48a0-8364-31eacf1678e0 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Action: 'create', calling method: .version_select at 0x7fe833d84310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-139115124"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:40.362967 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1615496b-bb5d-48a0-8364-31eacf1678e0 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.744872 Aug 10 23:27:40.363653 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 510/1012] 10.222.0.78 () {60 vars in 1155 bytes} [Wed Aug 10 23:27:39 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 747 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 23:27:40.375611 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7657bc48-275b-4112-8801-80fc895d0352 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe84046c940>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:40.424482 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7657bc48-275b-4112-8801-80fc895d0352 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15" status: 200 len: 344 microversion: 2.1 time: 0.052389 Aug 10 23:27:40.425295 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 503/1013] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:27:40 2022] GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:40.550621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-d669064a-b1d5-4db3-b9bc-7966bfc5c705 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:40.552949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-d669064a-b1d5-4db3-b9bc-7966bfc5c705 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:40.555131 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:40.560637 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d669064a-b1d5-4db3-b9bc-7966bfc5c705 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:40.561112 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d669064a-b1d5-4db3-b9bc-7966bfc5c705 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:40.561545 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d669064a-b1d5-4db3-b9bc-7966bfc5c705 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:40.562245 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d669064a-b1d5-4db3-b9bc-7966bfc5c705 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:40.562715 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d669064a-b1d5-4db3-b9bc-7966bfc5c705 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:40.563141 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-d669064a-b1d5-4db3-b9bc-7966bfc5c705 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:40.565677 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:40.807218 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-d669064a-b1d5-4db3-b9bc-7966bfc5c705 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "POST /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/action" status: 202 len: 0 microversion: 2.1 time: 0.260392 Aug 10 23:27:40.809164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 511/1014] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:27:40 2022] POST /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:27:40.816733 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-875bf8dd-4913-465e-9e10-07447ad6f73b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:40.817481 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-875bf8dd-4913-465e-9e10-07447ad6f73b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:40.823668 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-875bf8dd-4913-465e-9e10-07447ad6f73b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:40.824151 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-875bf8dd-4913-465e-9e10-07447ad6f73b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:40.824603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-875bf8dd-4913-465e-9e10-07447ad6f73b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:40.825302 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-875bf8dd-4913-465e-9e10-07447ad6f73b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:40.825754 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-875bf8dd-4913-465e-9e10-07447ad6f73b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:40.826171 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-875bf8dd-4913-465e-9e10-07447ad6f73b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:41.007672 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-875bf8dd-4913-465e-9e10-07447ad6f73b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:41.017976 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-875bf8dd-4913-465e-9e10-07447ad6f73b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1751 microversion: 2.1 time: 0.205875 Aug 10 23:27:41.019597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 504/1015] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:40 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:41.439556 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-927077c3-d673-477b-99da-444b6cf10ad8 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe833c52310>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:41.489472 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-927077c3-d673-477b-99da-444b6cf10ad8 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15" status: 200 len: 345 microversion: 2.1 time: 0.054553 Aug 10 23:27:41.490043 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 512/1016] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:27:41 2022] GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:41.503292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-27a257ac-64cc-4e44-baac-8c3376af3fa5 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Action: 'create', calling method: .version_select at 0x7fe84046c430>, body: {"snapshot": {"volume_id": "94798c23-9e67-48bf-bca2-b9dfad4e8f15", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-968728011"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:41.976854 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-27a257ac-64cc-4e44-baac-8c3376af3fa5 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.477404 Aug 10 23:27:41.977558 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 505/1017] 10.222.0.78 () {60 vars in 1162 bytes} [Wed Aug 10 23:27:41 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:41.990642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-03c9c19c-6804-4f7d-9aec-d3bad042b1ac tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe833e6ee50>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:42.020160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-03c9c19c-6804-4f7d-9aec-d3bad042b1ac tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f" status: 200 len: 286 microversion: 2.1 time: 0.035633 Aug 10 23:27:42.024623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 513/1018] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 10 23:27:41 2022] GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:42.031464 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a1cee643-0a04-4ba5-b420-aeae07db77f8 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe84040cca0>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:42.040475 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8f115f90-f69b-4e24-9e5b-c480661f6fce tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:42.041224 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8f115f90-f69b-4e24-9e5b-c480661f6fce tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:42.048471 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8f115f90-f69b-4e24-9e5b-c480661f6fce tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:42.048951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8f115f90-f69b-4e24-9e5b-c480661f6fce tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:42.049465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8f115f90-f69b-4e24-9e5b-c480661f6fce tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:42.050183 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8f115f90-f69b-4e24-9e5b-c480661f6fce tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:42.050646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8f115f90-f69b-4e24-9e5b-c480661f6fce tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:42.051210 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8f115f90-f69b-4e24-9e5b-c480661f6fce tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:42.063450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a1cee643-0a04-4ba5-b420-aeae07db77f8 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035708 Aug 10 23:27:42.064026 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 506/1019] 10.222.0.78 () {58 vars in 1140 bytes} [Wed Aug 10 23:27:42 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:42.074865 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-67232dd1-8887-4bf5-ba02-52c587a6acc2 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe8407758b0>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:42.106092 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-67232dd1-8887-4bf5-ba02-52c587a6acc2 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f" status: 200 len: 286 microversion: 2.1 time: 0.034997 Aug 10 23:27:42.106713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 507/1020] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 10 23:27:42 2022] GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:27:42.207356 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8f115f90-f69b-4e24-9e5b-c480661f6fce tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:42.215308 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8f115f90-f69b-4e24-9e5b-c480661f6fce tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.178859 Aug 10 23:27:42.217206 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 514/1021] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:42 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:27:43.119600 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-25cad875-368a-4fef-aceb-17c2aafeee1b tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe84068ac10>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:43.148213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-25cad875-368a-4fef-aceb-17c2aafeee1b tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f" status: 200 len: 286 microversion: 2.1 time: 0.033170 Aug 10 23:27:43.148779 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 508/1022] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 10 23:27:43 2022] GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:43.238114 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5f690169-ba02-410f-897a-d1fc3aa8c314 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:43.238757 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5f690169-ba02-410f-897a-d1fc3aa8c314 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:43.245317 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f690169-ba02-410f-897a-d1fc3aa8c314 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:43.245804 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f690169-ba02-410f-897a-d1fc3aa8c314 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:43.246253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f690169-ba02-410f-897a-d1fc3aa8c314 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:43.246988 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f690169-ba02-410f-897a-d1fc3aa8c314 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:43.247445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f690169-ba02-410f-897a-d1fc3aa8c314 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:43.247877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f690169-ba02-410f-897a-d1fc3aa8c314 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:43.387629 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5f690169-ba02-410f-897a-d1fc3aa8c314 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:43.396106 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5f690169-ba02-410f-897a-d1fc3aa8c314 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.162672 Aug 10 23:27:43.396670 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 515/1023] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:43 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:44.161908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-bb62903a-30f4-4db7-8ad3-5cbde3990d31 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe84058f1f0>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:44.197017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-bb62903a-30f4-4db7-8ad3-5cbde3990d31 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f" status: 200 len: 286 microversion: 2.1 time: 0.039834 Aug 10 23:27:44.197680 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 509/1024] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 10 23:27:44 2022] GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:44.418265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-82a88faa-b10a-4e85-b92e-b0ee5f6c3525 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:44.418956 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-82a88faa-b10a-4e85-b92e-b0ee5f6c3525 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:44.425655 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82a88faa-b10a-4e85-b92e-b0ee5f6c3525 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:44.426139 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82a88faa-b10a-4e85-b92e-b0ee5f6c3525 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:44.426833 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82a88faa-b10a-4e85-b92e-b0ee5f6c3525 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:44.427319 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82a88faa-b10a-4e85-b92e-b0ee5f6c3525 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:44.427777 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82a88faa-b10a-4e85-b92e-b0ee5f6c3525 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:44.428211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82a88faa-b10a-4e85-b92e-b0ee5f6c3525 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:44.573889 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-82a88faa-b10a-4e85-b92e-b0ee5f6c3525 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:44.582453 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-82a88faa-b10a-4e85-b92e-b0ee5f6c3525 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.168688 Aug 10 23:27:44.583047 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 516/1025] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:44 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:45.210810 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-323cd266-e969-413d-8bdc-fce74ca38613 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe8405fd820>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:45.240618 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-323cd266-e969-413d-8bdc-fce74ca38613 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f" status: 200 len: 286 microversion: 2.1 time: 0.034367 Aug 10 23:27:45.241186 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 510/1026] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 10 23:27:45 2022] GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:45.603654 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-eec09853-2211-4d9b-a3a7-dac11a3c1f5d tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:45.604192 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-eec09853-2211-4d9b-a3a7-dac11a3c1f5d tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:45.610597 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eec09853-2211-4d9b-a3a7-dac11a3c1f5d tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:45.611121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eec09853-2211-4d9b-a3a7-dac11a3c1f5d tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:45.611562 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eec09853-2211-4d9b-a3a7-dac11a3c1f5d tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:45.612943 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eec09853-2211-4d9b-a3a7-dac11a3c1f5d tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:45.613402 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eec09853-2211-4d9b-a3a7-dac11a3c1f5d tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:45.613835 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-eec09853-2211-4d9b-a3a7-dac11a3c1f5d tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:45.754576 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-eec09853-2211-4d9b-a3a7-dac11a3c1f5d tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:45.762895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-eec09853-2211-4d9b-a3a7-dac11a3c1f5d tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.163208 Aug 10 23:27:45.763458 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 517/1027] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:45 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:46.253376 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d088aa18-4781-45b0-9928-be840eac9d3b tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe840775a60>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:46.283330 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d088aa18-4781-45b0-9928-be840eac9d3b tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f" status: 200 len: 287 microversion: 2.1 time: 0.034936 Aug 10 23:27:46.287694 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 511/1028] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 10 23:27:46 2022] GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:46.294840 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-34cd263a-ebb3-4873-b7c4-b1eef1945f69 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe833e76ee0>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:46.424703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-34cd263a-ebb3-4873-b7c4-b1eef1945f69 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f" status: 202 len: 0 microversion: 2.1 time: 0.133218 Aug 10 23:27:46.429355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 518/1029] 10.222.0.78 () {58 vars in 1254 bytes} [Wed Aug 10 23:27:46 2022] DELETE /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:27:46.433540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-05400a6c-52ce-4c09-9540-b4abe21ae380 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe8406b9430>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:46.466397 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-05400a6c-52ce-4c09-9540-b4abe21ae380 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f" status: 200 len: 286 microversion: 2.1 time: 0.036667 Aug 10 23:27:46.467080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 512/1030] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 10 23:27:46 2022] GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:46.785646 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e60c9ab5-fe5c-4e26-848a-509f77cf8c48 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:46.786301 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e60c9ab5-fe5c-4e26-848a-509f77cf8c48 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:46.792191 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e60c9ab5-fe5c-4e26-848a-509f77cf8c48 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:46.792667 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e60c9ab5-fe5c-4e26-848a-509f77cf8c48 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:46.793104 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e60c9ab5-fe5c-4e26-848a-509f77cf8c48 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:46.793788 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e60c9ab5-fe5c-4e26-848a-509f77cf8c48 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:46.794234 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e60c9ab5-fe5c-4e26-848a-509f77cf8c48 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:46.794671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e60c9ab5-fe5c-4e26-848a-509f77cf8c48 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:46.936371 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e60c9ab5-fe5c-4e26-848a-509f77cf8c48 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:46.945128 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e60c9ab5-fe5c-4e26-848a-509f77cf8c48 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.164477 Aug 10 23:27:46.945700 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 519/1031] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:46 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:47.479126 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d4397b5a-17d0-490e-bdfc-01f505d58a4d tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe84059df70>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:47.504157 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-d4397b5a-17d0-490e-bdfc-01f505d58a4d tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] HTTP exception thrown: Snapshot 02a0d0b8-f2f0-4f20-8429-2da6939a941f could not be found. Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d4397b5a-17d0-490e-bdfc-01f505d58a4d tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Request method failure captured: Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f HTTP/1.1 Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D7rbH3qJSjfJsFc5H99UjVknSUdFmToPaAIvmYakuwFKpDKbaiLk8gUbpkO45nO1SEzKbQEsa3pnxYPZysJgYF_m1wZ5IiX9OSCptm-Rcz43_18vrAo1_D4rhQaEn353No-60I4NtEamoLE3boaBT-9OcelVQj6LMd2pSrQ0BA1T6U Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 04b15d4063dc465f8c5780f626f0477d Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:27:47.506400 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_04b15d4063dc465f8c5780f626f0477d", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 04b15d4063dc465f8c5780f626f0477d Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-VolumesSnapshotsTestJSON-1848951633-project Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: a00a44f349cb4d3f98ea26210d46a455 Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1848951633-project Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Snapshot 02a0d0b8-f2f0-4f20-8429-2da6939a941f could not be found. Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '02a0d0b8-f2f0-4f20-8429-2da6939a941f'} Aug 10 23:27:47.508249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 02a0d0b8-f2f0-4f20-8429-2da6939a941f could not be found. (HTTP 404) (Request-ID: req-26c6dfe5-03e1-487f-bf83-5d366eed7850) Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:47.509201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:27:47.510727 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 02a0d0b8-f2f0-4f20-8429-2da6939a941f could not be found. Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 23:27:47.512538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 02a0d0b8-f2f0-4f20-8429-2da6939a941f could not be found. Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 02a0d0b8-f2f0-4f20-8429-2da6939a941f could not be found. Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d4397b5a-17d0-490e-bdfc-01f505d58a4d tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Returning 404 to user: Snapshot 02a0d0b8-f2f0-4f20-8429-2da6939a941f could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:27:47.514178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d4397b5a-17d0-490e-bdfc-01f505d58a4d tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f" status: 404 len: 111 microversion: 2.1 time: 0.033076 Aug 10 23:27:47.515307 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 513/1032] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 10 23:27:47 2022] GET /compute/v2.1/os-snapshots/02a0d0b8-f2f0-4f20-8429-2da6939a941f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:27:47.516405 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8fbef2bb-1f2b-4b15-987b-001b361f8c6e tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe833e76430>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:47.714317 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8fbef2bb-1f2b-4b15-987b-001b361f8c6e tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15" status: 202 len: 0 microversion: 2.1 time: 0.201535 Aug 10 23:27:47.715073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 520/1033] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 10 23:27:47 2022] DELETE /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:27:47.724135 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7c80d0b6-f6b8-46f7-978a-49628acccc99 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe8404f4430>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:47.771015 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7c80d0b6-f6b8-46f7-978a-49628acccc99 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15" status: 200 len: 344 microversion: 2.1 time: 0.051322 Aug 10 23:27:47.771574 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 514/1034] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:27:47 2022] GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:47.968497 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5f33960d-4f6e-4234-b460-11854e3f1f59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:47.969018 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5f33960d-4f6e-4234-b460-11854e3f1f59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:47.976073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f33960d-4f6e-4234-b460-11854e3f1f59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:47.976551 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f33960d-4f6e-4234-b460-11854e3f1f59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:47.976984 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f33960d-4f6e-4234-b460-11854e3f1f59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:47.977671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f33960d-4f6e-4234-b460-11854e3f1f59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:47.978120 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f33960d-4f6e-4234-b460-11854e3f1f59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:47.978539 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5f33960d-4f6e-4234-b460-11854e3f1f59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:48.123778 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5f33960d-4f6e-4234-b460-11854e3f1f59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:48.131843 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5f33960d-4f6e-4234-b460-11854e3f1f59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.167767 Aug 10 23:27:48.132412 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 521/1035] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:47 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:48.784620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-33aacb61-cfe7-4897-bc1e-c814f9acd1e9 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe840775ee0>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:48.811903 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-33aacb61-cfe7-4897-bc1e-c814f9acd1e9 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] HTTP exception thrown: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-33aacb61-cfe7-4897-bc1e-c814f9acd1e9 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Request method failure captured: Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15 HTTP/1.1 Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D7rbH3qJSjfJsFc5H99UjVknSUdFmToPaAIvmYakuwFKpDKbaiLk8gUbpkO45nO1SEzKbQEsa3pnxYPZysJgYF_m1wZ5IiX9OSCptm-Rcz43_18vrAo1_D4rhQaEn353No-60I4NtEamoLE3boaBT-9OcelVQj6LMd2pSrQ0BA1T6U Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 04b15d4063dc465f8c5780f626f0477d Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:27:48.813864 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_04b15d4063dc465f8c5780f626f0477d", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 04b15d4063dc465f8c5780f626f0477d Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-VolumesSnapshotsTestJSON-1848951633-project Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: a00a44f349cb4d3f98ea26210d46a455 Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1848951633-project Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '94798c23-9e67-48bf-bca2-b9dfad4e8f15'} Aug 10 23:27:48.815559 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. (HTTP 404) (Request-ID: req-47dd03ba-6f40-451c-a7b5-8c4ff99434ca) Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:48.816594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:27:48.818523 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 23:27:48.820220 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-33aacb61-cfe7-4897-bc1e-c814f9acd1e9 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Returning 404 to user: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-33aacb61-cfe7-4897-bc1e-c814f9acd1e9 tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15" status: 404 len: 109 microversion: 2.1 time: 0.035094 Aug 10 23:27:48.831443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 515/1036] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:27:48 2022] GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:27:48.832625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-20c83021-6b89-4e59-9a42-62bb3e9b75bc tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe833e53670>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-20c83021-6b89-4e59-9a42-62bb3e9b75bc tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] HTTP exception thrown: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-20c83021-6b89-4e59-9a42-62bb3e9b75bc tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Request method failure captured: Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: DELETE /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15 HTTP/1.1 Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D7rbH3qJSjfJsFc5H99UjVknSUdFmToPaAIvmYakuwFKpDKbaiLk8gUbpkO45nO1SEzKbQEsa3pnxYPZysJgYF_m1wZ5IiX9OSCptm-Rcz43_18vrAo1_D4rhQaEn353No-60I4NtEamoLE3boaBT-9OcelVQj6LMd2pSrQ0BA1T6U Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 04b15d4063dc465f8c5780f626f0477d Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:27:48.862429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_04b15d4063dc465f8c5780f626f0477d", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 04b15d4063dc465f8c5780f626f0477d Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-VolumesSnapshotsTestJSON-1848951633-project Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: a00a44f349cb4d3f98ea26210d46a455 Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1848951633-project Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': '94798c23-9e67-48bf-bca2-b9dfad4e8f15'} Aug 10 23:27:48.864423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. (HTTP 404) (Request-ID: req-6b03f2b6-2a5c-4882-8597-205c9c047faf) Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:48.865492 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:27:48.867154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 23:27:48.868611 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-20c83021-6b89-4e59-9a42-62bb3e9b75bc tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Returning 404 to user: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:27:48.870148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-20c83021-6b89-4e59-9a42-62bb3e9b75bc tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15" status: 404 len: 109 microversion: 2.1 time: 0.035977 Aug 10 23:27:48.871310 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 522/1037] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 10 23:27:48 2022] DELETE /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:27:48.871411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-81e796c9-4abe-4ab7-a3df-2d1271b0ee9e tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Calling method '.version_select at 0x7fe84059daf0>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:48.899265 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-81e796c9-4abe-4ab7-a3df-2d1271b0ee9e tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] HTTP exception thrown: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-81e796c9-4abe-4ab7-a3df-2d1271b0ee9e tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Request method failure captured: Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15 HTTP/1.1 Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D7rbH3qJSjfJsFc5H99UjVknSUdFmToPaAIvmYakuwFKpDKbaiLk8gUbpkO45nO1SEzKbQEsa3pnxYPZysJgYF_m1wZ5IiX9OSCptm-Rcz43_18vrAo1_D4rhQaEn353No-60I4NtEamoLE3boaBT-9OcelVQj6LMd2pSrQ0BA1T6U Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 04b15d4063dc465f8c5780f626f0477d Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:27:48.901247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/04b15d4063dc465f8c5780f626f0477d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_04b15d4063dc465f8c5780f626f0477d", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 04b15d4063dc465f8c5780f626f0477d Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1848951633 Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-VolumesSnapshotsTestJSON-1848951633-project Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: a00a44f349cb4d3f98ea26210d46a455 Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1848951633-project Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '94798c23-9e67-48bf-bca2-b9dfad4e8f15'} Aug 10 23:27:48.902901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. (HTTP 404) (Request-ID: req-8141980f-2738-4771-83a2-159abc4b8bca) Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:48.904068 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:27:48.905537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 23:27:48.907147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-81e796c9-4abe-4ab7-a3df-2d1271b0ee9e tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] Returning 404 to user: Volume 94798c23-9e67-48bf-bca2-b9dfad4e8f15 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-81e796c9-4abe-4ab7-a3df-2d1271b0ee9e tempest-VolumesSnapshotsTestJSON-1848951633 tempest-VolumesSnapshotsTestJSON-1848951633-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15" status: 404 len: 109 microversion: 2.1 time: 0.035679 Aug 10 23:27:48.908677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 516/1038] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 10 23:27:48 2022] GET /compute/v2.1/os-volumes/94798c23-9e67-48bf-bca2-b9dfad4e8f15 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:27:49.153993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-bf952721-41db-49de-80be-39e48bd08e1b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:49.154599 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bf952721-41db-49de-80be-39e48bd08e1b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:49.161421 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf952721-41db-49de-80be-39e48bd08e1b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:49.161901 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf952721-41db-49de-80be-39e48bd08e1b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:49.162335 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf952721-41db-49de-80be-39e48bd08e1b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:49.163062 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf952721-41db-49de-80be-39e48bd08e1b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:49.163517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf952721-41db-49de-80be-39e48bd08e1b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:49.163968 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bf952721-41db-49de-80be-39e48bd08e1b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:49.311093 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-bf952721-41db-49de-80be-39e48bd08e1b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:49.319280 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-bf952721-41db-49de-80be-39e48bd08e1b tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.169601 Aug 10 23:27:49.319854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 523/1039] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:49 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:27:50.341150 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-55b69828-8e92-4716-b45b-092cc101a76a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:50.341793 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-55b69828-8e92-4716-b45b-092cc101a76a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:50.343767 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:50.350575 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-55b69828-8e92-4716-b45b-092cc101a76a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:50.351104 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-55b69828-8e92-4716-b45b-092cc101a76a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:50.351547 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-55b69828-8e92-4716-b45b-092cc101a76a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:50.352321 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-55b69828-8e92-4716-b45b-092cc101a76a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:50.352952 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-55b69828-8e92-4716-b45b-092cc101a76a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:50.353391 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-55b69828-8e92-4716-b45b-092cc101a76a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:50.357656 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:50.583010 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-55b69828-8e92-4716-b45b-092cc101a76a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:50.591988 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-55b69828-8e92-4716-b45b-092cc101a76a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.255224 Aug 10 23:27:50.592563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 517/1040] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:50 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:51.613200 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c1df3ec2-c9c3-4233-b9b5-635d265db622 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:51.613814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c1df3ec2-c9c3-4233-b9b5-635d265db622 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:51.620762 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1df3ec2-c9c3-4233-b9b5-635d265db622 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:51.621241 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1df3ec2-c9c3-4233-b9b5-635d265db622 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:51.621675 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1df3ec2-c9c3-4233-b9b5-635d265db622 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:51.622585 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1df3ec2-c9c3-4233-b9b5-635d265db622 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:51.623071 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1df3ec2-c9c3-4233-b9b5-635d265db622 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:51.623497 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c1df3ec2-c9c3-4233-b9b5-635d265db622 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:51.769429 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c1df3ec2-c9c3-4233-b9b5-635d265db622 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:51.777705 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c1df3ec2-c9c3-4233-b9b5-635d265db622 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.168278 Aug 10 23:27:51.778304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 524/1041] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:51 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:52.798832 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9d98dce9-41cb-431f-9ad4-70bf1fd9efea tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:52.799447 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9d98dce9-41cb-431f-9ad4-70bf1fd9efea tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:52.806960 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d98dce9-41cb-431f-9ad4-70bf1fd9efea tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:52.807447 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d98dce9-41cb-431f-9ad4-70bf1fd9efea tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:52.807887 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d98dce9-41cb-431f-9ad4-70bf1fd9efea tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:52.808591 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d98dce9-41cb-431f-9ad4-70bf1fd9efea tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:52.809046 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d98dce9-41cb-431f-9ad4-70bf1fd9efea tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:52.809472 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d98dce9-41cb-431f-9ad4-70bf1fd9efea tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:52.960169 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9d98dce9-41cb-431f-9ad4-70bf1fd9efea tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:52.970703 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9d98dce9-41cb-431f-9ad4-70bf1fd9efea tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.175641 Aug 10 23:27:52.971334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 518/1042] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:52 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:53.991981 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6d9a15a5-3d4b-4535-8bd7-a8bcf4586067 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:53.992589 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6d9a15a5-3d4b-4535-8bd7-a8bcf4586067 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:53.999826 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d9a15a5-3d4b-4535-8bd7-a8bcf4586067 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:54.000310 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d9a15a5-3d4b-4535-8bd7-a8bcf4586067 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:54.000748 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d9a15a5-3d4b-4535-8bd7-a8bcf4586067 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:54.001457 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d9a15a5-3d4b-4535-8bd7-a8bcf4586067 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:54.001913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d9a15a5-3d4b-4535-8bd7-a8bcf4586067 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:54.002459 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6d9a15a5-3d4b-4535-8bd7-a8bcf4586067 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:54.154687 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6d9a15a5-3d4b-4535-8bd7-a8bcf4586067 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:54.162863 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6d9a15a5-3d4b-4535-8bd7-a8bcf4586067 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.174742 Aug 10 23:27:54.163440 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 525/1043] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:53 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:55.183787 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-427608a6-0c62-40b8-b853-3f7bce1db72c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:55.184397 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-427608a6-0c62-40b8-b853-3f7bce1db72c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:55.190863 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-427608a6-0c62-40b8-b853-3f7bce1db72c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:55.191369 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-427608a6-0c62-40b8-b853-3f7bce1db72c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:55.191796 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-427608a6-0c62-40b8-b853-3f7bce1db72c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:55.192490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-427608a6-0c62-40b8-b853-3f7bce1db72c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:55.192940 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-427608a6-0c62-40b8-b853-3f7bce1db72c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:55.193358 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-427608a6-0c62-40b8-b853-3f7bce1db72c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:55.342904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-427608a6-0c62-40b8-b853-3f7bce1db72c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:55.351414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-427608a6-0c62-40b8-b853-3f7bce1db72c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.171690 Aug 10 23:27:55.352198 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 519/1044] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:55 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:56.372792 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-29195af5-81e9-498c-8af0-578b1bb2a38a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:56.373396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-29195af5-81e9-498c-8af0-578b1bb2a38a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:56.379875 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-29195af5-81e9-498c-8af0-578b1bb2a38a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:56.380863 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-29195af5-81e9-498c-8af0-578b1bb2a38a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:56.381297 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-29195af5-81e9-498c-8af0-578b1bb2a38a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:56.382003 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-29195af5-81e9-498c-8af0-578b1bb2a38a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:56.382452 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-29195af5-81e9-498c-8af0-578b1bb2a38a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:56.382904 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-29195af5-81e9-498c-8af0-578b1bb2a38a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:56.532801 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-29195af5-81e9-498c-8af0-578b1bb2a38a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:56.540887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-29195af5-81e9-498c-8af0-578b1bb2a38a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1756 microversion: 2.1 time: 0.172089 Aug 10 23:27:56.541456 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 526/1045] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:56 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:57.563110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2cf554e7-423a-4708-ad06-a19a9ab669ba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:57.563872 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2cf554e7-423a-4708-ad06-a19a9ab669ba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:57.570969 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cf554e7-423a-4708-ad06-a19a9ab669ba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:57.571572 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cf554e7-423a-4708-ad06-a19a9ab669ba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:57.572074 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cf554e7-423a-4708-ad06-a19a9ab669ba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:57.572787 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cf554e7-423a-4708-ad06-a19a9ab669ba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:57.573242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cf554e7-423a-4708-ad06-a19a9ab669ba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:57.573666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2cf554e7-423a-4708-ad06-a19a9ab669ba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:57.734317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2cf554e7-423a-4708-ad06-a19a9ab669ba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:57.742897 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2cf554e7-423a-4708-ad06-a19a9ab669ba tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1759 microversion: 2.1 time: 0.183612 Aug 10 23:27:57.743852 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 520/1046] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:27:57 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:13.322082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-75af7300-ac88-4136-ad36-2ff8849e3ab9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:13.322082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-75af7300-ac88-4136-ad36-2ff8849e3ab9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:13.324913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=21 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:13.325195 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:13.330252 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75af7300-ac88-4136-ad36-2ff8849e3ab9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:13.332314 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75af7300-ac88-4136-ad36-2ff8849e3ab9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:13.332314 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75af7300-ac88-4136-ad36-2ff8849e3ab9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:13.332314 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75af7300-ac88-4136-ad36-2ff8849e3ab9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:13.332314 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75af7300-ac88-4136-ad36-2ff8849e3ab9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:13.332824 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-75af7300-ac88-4136-ad36-2ff8849e3ab9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:13.358406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-75af7300-ac88-4136-ad36-2ff8849e3ab9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Going to try to terminate instance {{(pid=121332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:28:13.713737 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-75af7300-ac88-4136-ad36-2ff8849e3ab9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 204 len: 0 microversion: 2.1 time: 0.396237 Aug 10 23:28:13.714327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 527/1047] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:28:13 2022] DELETE /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:28:13.722569 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8d57ec01-11bd-4e95-846b-4a5c758800df tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:13.723213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8d57ec01-11bd-4e95-846b-4a5c758800df tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:13.725939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=7 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:13.726608 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=23 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:13.731326 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8d57ec01-11bd-4e95-846b-4a5c758800df tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:13.732878 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8d57ec01-11bd-4e95-846b-4a5c758800df tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:13.732878 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8d57ec01-11bd-4e95-846b-4a5c758800df tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:13.733234 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8d57ec01-11bd-4e95-846b-4a5c758800df tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:13.733698 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8d57ec01-11bd-4e95-846b-4a5c758800df tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:13.734127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8d57ec01-11bd-4e95-846b-4a5c758800df tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:13.870728 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8d57ec01-11bd-4e95-846b-4a5c758800df tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:13.879128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8d57ec01-11bd-4e95-846b-4a5c758800df tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1578 microversion: 2.1 time: 0.160524 Aug 10 23:28:13.879758 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 521/1048] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:13 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:14.901217 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1bb8c6a9-802a-404e-8b7e-00a6f40d4cd0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:14.901948 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1bb8c6a9-802a-404e-8b7e-00a6f40d4cd0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:14.912364 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bb8c6a9-802a-404e-8b7e-00a6f40d4cd0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:14.913139 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bb8c6a9-802a-404e-8b7e-00a6f40d4cd0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:14.913285 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bb8c6a9-802a-404e-8b7e-00a6f40d4cd0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:14.913987 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bb8c6a9-802a-404e-8b7e-00a6f40d4cd0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:14.914441 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bb8c6a9-802a-404e-8b7e-00a6f40d4cd0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:14.914906 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1bb8c6a9-802a-404e-8b7e-00a6f40d4cd0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:15.045946 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1bb8c6a9-802a-404e-8b7e-00a6f40d4cd0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:15.053393 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1bb8c6a9-802a-404e-8b7e-00a6f40d4cd0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1578 microversion: 2.1 time: 0.156641 Aug 10 23:28:15.053960 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 528/1049] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:14 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:16.074791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a42c47b0-ac34-428c-817f-8477377aff0e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:16.075489 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a42c47b0-ac34-428c-817f-8477377aff0e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:16.082388 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42c47b0-ac34-428c-817f-8477377aff0e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:16.082921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42c47b0-ac34-428c-817f-8477377aff0e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:16.083369 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42c47b0-ac34-428c-817f-8477377aff0e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:16.084095 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42c47b0-ac34-428c-817f-8477377aff0e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:16.084558 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42c47b0-ac34-428c-817f-8477377aff0e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:16.084993 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-a42c47b0-ac34-428c-817f-8477377aff0e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:16.547729 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a42c47b0-ac34-428c-817f-8477377aff0e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:16.555653 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a42c47b0-ac34-428c-817f-8477377aff0e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1578 microversion: 2.1 time: 0.484762 Aug 10 23:28:16.556239 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 522/1050] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:16 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1578 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:17.329177 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-2b8371fe-c370-47bf-8cf9-9e7d55d61ad2 req-c0dedc0e-58f9-4dec-9aa0-36f771e9c5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b873b552-1351-4f68-88f2-08fc66c4e21c", "name": "network-vif-deleted", "tag": "9ed91d66-53a0-4ddd-a2be-ade214566003"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:17.339678 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-2b8371fe-c370-47bf-8cf9-9e7d55d61ad2 req-c0dedc0e-58f9-4dec-9aa0-36f771e9c5af service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:17.341680 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-2b8371fe-c370-47bf-8cf9-9e7d55d61ad2 req-c0dedc0e-58f9-4dec-9aa0-36f771e9c5af service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:17.341680 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-2b8371fe-c370-47bf-8cf9-9e7d55d61ad2 req-c0dedc0e-58f9-4dec-9aa0-36f771e9c5af service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:17.365307 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-2b8371fe-c370-47bf-8cf9-9e7d55d61ad2 req-c0dedc0e-58f9-4dec-9aa0-36f771e9c5af service nova] Creating event network-vif-deleted:9ed91d66-53a0-4ddd-a2be-ade214566003 for instance b873b552-1351-4f68-88f2-08fc66c4e21c on hv-cinder-85144 Aug 10 23:28:17.375654 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-2b8371fe-c370-47bf-8cf9-9e7d55d61ad2 req-c0dedc0e-58f9-4dec-9aa0-36f771e9c5af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050018 Aug 10 23:28:17.376833 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 529/1051] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:28:17.577159 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-56b7e0e1-0d21-413d-94ad-219f27413f3e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:17.577783 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-56b7e0e1-0d21-413d-94ad-219f27413f3e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:17.586238 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-56b7e0e1-0d21-413d-94ad-219f27413f3e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:17.586772 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-56b7e0e1-0d21-413d-94ad-219f27413f3e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:17.587216 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-56b7e0e1-0d21-413d-94ad-219f27413f3e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:17.587943 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-56b7e0e1-0d21-413d-94ad-219f27413f3e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:17.588402 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-56b7e0e1-0d21-413d-94ad-219f27413f3e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:17.588827 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-56b7e0e1-0d21-413d-94ad-219f27413f3e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:17.661755 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-56b7e0e1-0d21-413d-94ad-219f27413f3e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:17.674329 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-56b7e0e1-0d21-413d-94ad-219f27413f3e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 200 len: 1225 microversion: 2.1 time: 0.099478 Aug 10 23:28:17.675192 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 523/1052] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:17 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:18.696149 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:18.696847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:18.703522 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:18.704017 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:18.704440 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:18.705400 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:18.705853 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:18.706275 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:18.719768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] HTTP exception thrown: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Request method failure captured: Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c HTTP/1.1 Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D5IxOStWrckVjfeZ-c9oxhRh3RI7Kvmftyu7o7MapUqG7-kmsXHZGriQpAgwl1MxRQKh9QWRC8pn-mPSGyKFb5MSFoHwrAEzEa5ePdF9mtfK678GTght-HLruzPttDqBm-6Wk7erd9Fsfs76YPNqQ19NCNlWXaWAyPhVdcn28fYrPA Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 8d2bfa865669477f8757e977da29420a Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-TestVolumeBootPattern-704763467 Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:28:18.721389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d2bfa865669477f8757e977da29420a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d2bfa865669477f8757e977da29420a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8d2bfa865669477f8757e977da29420a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8d2bfa865669477f8757e977da29420a", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-TestVolumeBootPattern-704763467 Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 8d2bfa865669477f8757e977da29420a Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-TestVolumeBootPattern-704763467 Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-TestVolumeBootPattern-704763467-project Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 05e18a4fd73e435aa6d0f10a37405698 Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-TestVolumeBootPattern-704763467-project Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:28:18.726802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'b873b552-1351-4f68-88f2-08fc66c4e21c'} Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:28:18.727849 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:28:18.729796 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:28:18.731807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Returning 404 to user: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:28:18.731807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ae697158-a618-4586-af72-295060514d89 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 404 len: 111 microversion: 2.1 time: 0.031023 Aug 10 23:28:18.731807 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 530/1053] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:18 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:28:18.823081 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1334388995", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1887301686", "security_groups": [{"name": "tempest-secgroup-smoke-2115761121"}], "block_device_mapping_v2": [{"uuid": "8582815f-60d1-4433-8be4-cd86e1d35cac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "261d6c55-7a8c-4ed0-b668-a538a8c25216"}]}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:18.936546 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] validate_networks() for [('261d6c55-7a8c-4ed0-b668-a538a8c25216', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:28:19.296638 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:28:19.297096 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:28:19.297573 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:28:19.297982 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:28:19.298395 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:28:19.307547 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:19.308026 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:19.308519 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:19.309250 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:19.309700 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:19.310130 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:19.327424 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Getting quotas for project 8d2bfa865669477f8757e977da29420a. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:28:19.331632 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Getting quotas for user 05e18a4fd73e435aa6d0f10a37405698 and project 8d2bfa865669477f8757e977da29420a. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:28:19.391819 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:28:19.393893 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8582815f-60d1-4433-8be4-cd86e1d35cac',volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:28:19.976428 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [1c62f045-f7e2-44ed-a41c-57ff9bcfcf6c] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:28:20.984243 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO oslo.messaging._drivers.impl_rabbit [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [1c62f045-f7e2-44ed-a41c-57ff9bcfcf6c] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 33040. Aug 10 23:28:20.988183 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-fbff65ee-aa99-4b84-86a1-27d64ef0417e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.169142 Aug 10 23:28:20.993620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 524/1054] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:28:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:28:21.001078 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1d08842f-0ab2-460f-89be-27db65995f41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:21.001722 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1d08842f-0ab2-460f-89be-27db65995f41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:21.058615 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1d08842f-0ab2-460f-89be-27db65995f41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:21.062946 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1d08842f-0ab2-460f-89be-27db65995f41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1095 microversion: 2.1 time: 0.066317 Aug 10 23:28:21.063507 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 531/1055] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:20 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:22.083546 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-a80c22e9-0de5-4822-8b13-8cb262524429 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:22.084175 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-a80c22e9-0de5-4822-8b13-8cb262524429 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:22.137007 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-a80c22e9-0de5-4822-8b13-8cb262524429 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:22.143743 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-a80c22e9-0de5-4822-8b13-8cb262524429 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1095 microversion: 2.1 time: 0.064477 Aug 10 23:28:22.144311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 525/1056] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:22 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:23.165121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-33234b73-e7a1-4410-b9a7-77bddd9243b1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:23.166312 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-33234b73-e7a1-4410-b9a7-77bddd9243b1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:23.227470 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-33234b73-e7a1-4410-b9a7-77bddd9243b1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:23.234268 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-33234b73-e7a1-4410-b9a7-77bddd9243b1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1095 microversion: 2.1 time: 0.074069 Aug 10 23:28:23.241301 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 532/1057] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:23 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:24.255373 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c1687aa9-93cb-489b-afc4-41a450c97684 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:24.255977 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c1687aa9-93cb-489b-afc4-41a450c97684 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:24.309196 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c1687aa9-93cb-489b-afc4-41a450c97684 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:24.317988 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c1687aa9-93cb-489b-afc4-41a450c97684 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1095 microversion: 2.1 time: 0.066434 Aug 10 23:28:24.318578 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 526/1058] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:24 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:25.339040 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-44014035-b5a8-4472-8265-e8f0e2ce0246 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:25.339665 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-44014035-b5a8-4472-8265-e8f0e2ce0246 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:25.348750 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44014035-b5a8-4472-8265-e8f0e2ce0246 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:25.349621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44014035-b5a8-4472-8265-e8f0e2ce0246 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:25.350378 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44014035-b5a8-4472-8265-e8f0e2ce0246 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:25.351559 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44014035-b5a8-4472-8265-e8f0e2ce0246 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:25.352136 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44014035-b5a8-4472-8265-e8f0e2ce0246 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:25.352565 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-44014035-b5a8-4472-8265-e8f0e2ce0246 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:25.425845 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-44014035-b5a8-4472-8265-e8f0e2ce0246 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:25.435761 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-44014035-b5a8-4472-8265-e8f0e2ce0246 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1145 microversion: 2.1 time: 0.100489 Aug 10 23:28:25.438883 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 533/1059] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:25 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1145 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:26.457133 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-0feceb9b-8f53-45f1-b67a-a41f63168b6f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:26.457743 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-0feceb9b-8f53-45f1-b67a-a41f63168b6f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:26.465032 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feceb9b-8f53-45f1-b67a-a41f63168b6f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:26.465511 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feceb9b-8f53-45f1-b67a-a41f63168b6f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:26.475541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feceb9b-8f53-45f1-b67a-a41f63168b6f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:26.475541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feceb9b-8f53-45f1-b67a-a41f63168b6f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:26.475541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feceb9b-8f53-45f1-b67a-a41f63168b6f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:26.475541 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-0feceb9b-8f53-45f1-b67a-a41f63168b6f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:26.533209 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-0feceb9b-8f53-45f1-b67a-a41f63168b6f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:26.541053 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-0feceb9b-8f53-45f1-b67a-a41f63168b6f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1137 microversion: 2.1 time: 0.088115 Aug 10 23:28:26.541616 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 527/1060] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:26 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1137 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:27.561309 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-1cd28ab8-3a61-43c4-b3d9-8148945663aa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:27.562056 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-1cd28ab8-3a61-43c4-b3d9-8148945663aa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:27.568450 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1cd28ab8-3a61-43c4-b3d9-8148945663aa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:27.568937 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1cd28ab8-3a61-43c4-b3d9-8148945663aa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:27.569374 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1cd28ab8-3a61-43c4-b3d9-8148945663aa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:27.570075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1cd28ab8-3a61-43c4-b3d9-8148945663aa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:27.570534 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1cd28ab8-3a61-43c4-b3d9-8148945663aa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:27.570992 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-1cd28ab8-3a61-43c4-b3d9-8148945663aa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:27.657116 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-1cd28ab8-3a61-43c4-b3d9-8148945663aa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:27.666772 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-1cd28ab8-3a61-43c4-b3d9-8148945663aa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1211 microversion: 2.1 time: 0.109226 Aug 10 23:28:27.667938 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 534/1061] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:27 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:28.688716 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-04a376c0-ae42-40b7-96a9-185744c75b9a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:28.689354 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-04a376c0-ae42-40b7-96a9-185744c75b9a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:28.695918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-04a376c0-ae42-40b7-96a9-185744c75b9a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:28.696393 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-04a376c0-ae42-40b7-96a9-185744c75b9a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:28.696822 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-04a376c0-ae42-40b7-96a9-185744c75b9a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:28.697507 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-04a376c0-ae42-40b7-96a9-185744c75b9a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:28.697954 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-04a376c0-ae42-40b7-96a9-185744c75b9a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:28.698372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-04a376c0-ae42-40b7-96a9-185744c75b9a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:28.825850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-04a376c0-ae42-40b7-96a9-185744c75b9a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:28.833493 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-04a376c0-ae42-40b7-96a9-185744c75b9a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1279 microversion: 2.1 time: 0.148751 Aug 10 23:28:28.834074 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 528/1062] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:28 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:29.688169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-d81e8bf9-64c7-4eca-960c-8b6fad8eb997 req-2b879c06-3096-433c-80da-ee77cccc58fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c344d4-3cad-4938-8631-f0320f44d333", "tag": "bbe68c6c-c2d2-4ac4-9443-f6a999af222f"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:29.698100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-d81e8bf9-64c7-4eca-960c-8b6fad8eb997 req-2b879c06-3096-433c-80da-ee77cccc58fe service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:29.698604 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-d81e8bf9-64c7-4eca-960c-8b6fad8eb997 req-2b879c06-3096-433c-80da-ee77cccc58fe service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:29.699094 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-d81e8bf9-64c7-4eca-960c-8b6fad8eb997 req-2b879c06-3096-433c-80da-ee77cccc58fe service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:29.712948 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-d81e8bf9-64c7-4eca-960c-8b6fad8eb997 req-2b879c06-3096-433c-80da-ee77cccc58fe service nova] Creating event network-changed:bbe68c6c-c2d2-4ac4-9443-f6a999af222f for instance 47c344d4-3cad-4938-8631-f0320f44d333 on hv-cinder-85144 Aug 10 23:28:29.718710 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-d81e8bf9-64c7-4eca-960c-8b6fad8eb997 req-2b879c06-3096-433c-80da-ee77cccc58fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034240 Aug 10 23:28:29.719237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 535/1063] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:28:29.853902 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e6cfecfd-9f2e-40d3-8bf7-227532038a41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:29.854550 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e6cfecfd-9f2e-40d3-8bf7-227532038a41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:29.856535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:29.861804 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6cfecfd-9f2e-40d3-8bf7-227532038a41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:29.862272 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6cfecfd-9f2e-40d3-8bf7-227532038a41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:29.862729 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6cfecfd-9f2e-40d3-8bf7-227532038a41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:29.863426 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6cfecfd-9f2e-40d3-8bf7-227532038a41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:29.863874 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6cfecfd-9f2e-40d3-8bf7-227532038a41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:29.864291 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e6cfecfd-9f2e-40d3-8bf7-227532038a41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:30.010097 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e6cfecfd-9f2e-40d3-8bf7-227532038a41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:30.018259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e6cfecfd-9f2e-40d3-8bf7-227532038a41 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1279 microversion: 2.1 time: 0.168792 Aug 10 23:28:30.018860 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 529/1064] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:29 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:31.040136 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b0fd6913-bc92-4c94-a79d-d564cbdfa9e1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:31.040820 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b0fd6913-bc92-4c94-a79d-d564cbdfa9e1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:31.048064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0fd6913-bc92-4c94-a79d-d564cbdfa9e1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:31.048547 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0fd6913-bc92-4c94-a79d-d564cbdfa9e1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:31.048986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0fd6913-bc92-4c94-a79d-d564cbdfa9e1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:31.049683 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0fd6913-bc92-4c94-a79d-d564cbdfa9e1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:31.050136 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0fd6913-bc92-4c94-a79d-d564cbdfa9e1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:31.050566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0fd6913-bc92-4c94-a79d-d564cbdfa9e1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:31.258401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b0fd6913-bc92-4c94-a79d-d564cbdfa9e1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:31.266331 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b0fd6913-bc92-4c94-a79d-d564cbdfa9e1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1279 microversion: 2.1 time: 0.230430 Aug 10 23:28:31.267147 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 536/1065] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:31 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1279 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:32.287521 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b42643d4-bc4a-498c-88a9-f1f78521e937 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:32.288648 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b42643d4-bc4a-498c-88a9-f1f78521e937 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:32.296772 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b42643d4-bc4a-498c-88a9-f1f78521e937 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:32.297281 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b42643d4-bc4a-498c-88a9-f1f78521e937 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:32.298038 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b42643d4-bc4a-498c-88a9-f1f78521e937 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:32.299106 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b42643d4-bc4a-498c-88a9-f1f78521e937 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:32.299527 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b42643d4-bc4a-498c-88a9-f1f78521e937 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:32.299962 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b42643d4-bc4a-498c-88a9-f1f78521e937 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:32.458880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b42643d4-bc4a-498c-88a9-f1f78521e937 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:32.471443 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b42643d4-bc4a-498c-88a9-f1f78521e937 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1279 microversion: 2.1 time: 0.187874 Aug 10 23:28:32.472410 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 530/1066] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:32 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:33.493266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7ba7e2bb-45a1-4b56-a78b-cfedebeb03da tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:33.493872 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7ba7e2bb-45a1-4b56-a78b-cfedebeb03da tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:33.495848 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=4 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:33.502237 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ba7e2bb-45a1-4b56-a78b-cfedebeb03da tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:33.503127 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ba7e2bb-45a1-4b56-a78b-cfedebeb03da tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:33.503870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ba7e2bb-45a1-4b56-a78b-cfedebeb03da tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:33.504677 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ba7e2bb-45a1-4b56-a78b-cfedebeb03da tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:33.505343 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ba7e2bb-45a1-4b56-a78b-cfedebeb03da tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:33.506099 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7ba7e2bb-45a1-4b56-a78b-cfedebeb03da tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:33.794747 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7ba7e2bb-45a1-4b56-a78b-cfedebeb03da tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:33.801907 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7ba7e2bb-45a1-4b56-a78b-cfedebeb03da tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.312693 Aug 10 23:28:33.802595 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 537/1067] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:33 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:34.822551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d10b8c61-907a-46a7-afd4-e9eb79b1afc3 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:34.823185 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d10b8c61-907a-46a7-afd4-e9eb79b1afc3 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:34.825809 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=10 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:34.831050 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d10b8c61-907a-46a7-afd4-e9eb79b1afc3 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:34.832701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d10b8c61-907a-46a7-afd4-e9eb79b1afc3 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:34.832701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d10b8c61-907a-46a7-afd4-e9eb79b1afc3 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:34.832914 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d10b8c61-907a-46a7-afd4-e9eb79b1afc3 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:34.833719 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d10b8c61-907a-46a7-afd4-e9eb79b1afc3 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:34.833818 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d10b8c61-907a-46a7-afd4-e9eb79b1afc3 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:35.016466 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d10b8c61-907a-46a7-afd4-e9eb79b1afc3 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:35.023880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d10b8c61-907a-46a7-afd4-e9eb79b1afc3 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.205226 Aug 10 23:28:35.024445 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 531/1068] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:34 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:36.044554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c3adc433-9bff-41d4-88cf-727249a3c5d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:36.045077 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c3adc433-9bff-41d4-88cf-727249a3c5d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:36.051555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3adc433-9bff-41d4-88cf-727249a3c5d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:36.052039 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3adc433-9bff-41d4-88cf-727249a3c5d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:36.052474 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3adc433-9bff-41d4-88cf-727249a3c5d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:36.053166 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3adc433-9bff-41d4-88cf-727249a3c5d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:36.053650 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3adc433-9bff-41d4-88cf-727249a3c5d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:36.054079 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c3adc433-9bff-41d4-88cf-727249a3c5d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:36.187278 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c3adc433-9bff-41d4-88cf-727249a3c5d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:36.194868 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c3adc433-9bff-41d4-88cf-727249a3c5d1 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.154160 Aug 10 23:28:36.195625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 538/1069] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:36 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:37.216728 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d7649aa7-4c96-4923-8bea-fb6e6322a861 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:37.217346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d7649aa7-4c96-4923-8bea-fb6e6322a861 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:37.223719 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7649aa7-4c96-4923-8bea-fb6e6322a861 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:37.224297 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7649aa7-4c96-4923-8bea-fb6e6322a861 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:37.224731 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7649aa7-4c96-4923-8bea-fb6e6322a861 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:37.225438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7649aa7-4c96-4923-8bea-fb6e6322a861 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:37.225878 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7649aa7-4c96-4923-8bea-fb6e6322a861 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:37.226305 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d7649aa7-4c96-4923-8bea-fb6e6322a861 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:37.359670 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d7649aa7-4c96-4923-8bea-fb6e6322a861 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:37.367807 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d7649aa7-4c96-4923-8bea-fb6e6322a861 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.155481 Aug 10 23:28:37.368384 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 532/1070] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:37 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:38.388603 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-21abf829-037a-4837-bee6-de9af6a63253 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:38.389342 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-21abf829-037a-4837-bee6-de9af6a63253 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:38.396781 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-21abf829-037a-4837-bee6-de9af6a63253 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:38.397263 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-21abf829-037a-4837-bee6-de9af6a63253 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:38.397698 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-21abf829-037a-4837-bee6-de9af6a63253 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:38.398401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-21abf829-037a-4837-bee6-de9af6a63253 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:38.398890 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-21abf829-037a-4837-bee6-de9af6a63253 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:38.399319 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-21abf829-037a-4837-bee6-de9af6a63253 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:38.538034 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-21abf829-037a-4837-bee6-de9af6a63253 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:38.545517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-21abf829-037a-4837-bee6-de9af6a63253 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.161279 Aug 10 23:28:38.546087 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 539/1071] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:38 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:39.566760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-de6dff5f-00b1-496e-9fec-bc6b4486eb1a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:39.567374 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-de6dff5f-00b1-496e-9fec-bc6b4486eb1a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:39.573774 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-de6dff5f-00b1-496e-9fec-bc6b4486eb1a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:39.574257 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-de6dff5f-00b1-496e-9fec-bc6b4486eb1a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:39.574715 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-de6dff5f-00b1-496e-9fec-bc6b4486eb1a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:39.575410 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-de6dff5f-00b1-496e-9fec-bc6b4486eb1a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:39.575950 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-de6dff5f-00b1-496e-9fec-bc6b4486eb1a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:39.576366 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-de6dff5f-00b1-496e-9fec-bc6b4486eb1a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:39.707782 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-de6dff5f-00b1-496e-9fec-bc6b4486eb1a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:39.715665 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-de6dff5f-00b1-496e-9fec-bc6b4486eb1a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.152778 Aug 10 23:28:39.716372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 533/1072] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:39 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:39.923017 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:28:39.923502 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Wed Aug 10 23:28:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:28:40.741610 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0488a506-3f99-4d66-ae60-629343938305 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:40.742230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0488a506-3f99-4d66-ae60-629343938305 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:40.748585 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0488a506-3f99-4d66-ae60-629343938305 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:40.749065 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0488a506-3f99-4d66-ae60-629343938305 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:40.749499 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0488a506-3f99-4d66-ae60-629343938305 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:40.750226 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0488a506-3f99-4d66-ae60-629343938305 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:40.750697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0488a506-3f99-4d66-ae60-629343938305 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:40.751126 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0488a506-3f99-4d66-ae60-629343938305 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:40.893670 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-0488a506-3f99-4d66-ae60-629343938305 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:40.901294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0488a506-3f99-4d66-ae60-629343938305 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.163438 Aug 10 23:28:40.901859 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 540/1073] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:40 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:41.922473 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d3580793-15d8-466f-8e40-00607fd015ad tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:41.923283 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d3580793-15d8-466f-8e40-00607fd015ad tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:41.930373 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3580793-15d8-466f-8e40-00607fd015ad tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:41.930892 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3580793-15d8-466f-8e40-00607fd015ad tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:41.931351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3580793-15d8-466f-8e40-00607fd015ad tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:41.932025 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3580793-15d8-466f-8e40-00607fd015ad tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:41.932479 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3580793-15d8-466f-8e40-00607fd015ad tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:41.932904 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3580793-15d8-466f-8e40-00607fd015ad tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:42.075388 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d3580793-15d8-466f-8e40-00607fd015ad tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:42.083309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d3580793-15d8-466f-8e40-00607fd015ad tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.164730 Aug 10 23:28:42.083985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 534/1074] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:41 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:43.104987 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c5ebb5c6-68dc-4730-880e-c0608f5d5b18 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:43.105618 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c5ebb5c6-68dc-4730-880e-c0608f5d5b18 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:43.112939 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5ebb5c6-68dc-4730-880e-c0608f5d5b18 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:43.113430 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5ebb5c6-68dc-4730-880e-c0608f5d5b18 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:43.113869 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5ebb5c6-68dc-4730-880e-c0608f5d5b18 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:43.114559 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5ebb5c6-68dc-4730-880e-c0608f5d5b18 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:43.115039 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5ebb5c6-68dc-4730-880e-c0608f5d5b18 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:43.115462 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c5ebb5c6-68dc-4730-880e-c0608f5d5b18 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:43.244160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c5ebb5c6-68dc-4730-880e-c0608f5d5b18 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:43.251513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c5ebb5c6-68dc-4730-880e-c0608f5d5b18 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.150437 Aug 10 23:28:43.252069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 541/1075] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:43 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:44.271917 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e70fd6dd-0765-4846-85b7-1d005e362f1e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:44.272568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e70fd6dd-0765-4846-85b7-1d005e362f1e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:44.274946 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:44.279744 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e70fd6dd-0765-4846-85b7-1d005e362f1e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:44.280238 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e70fd6dd-0765-4846-85b7-1d005e362f1e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:44.280682 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e70fd6dd-0765-4846-85b7-1d005e362f1e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:44.281432 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e70fd6dd-0765-4846-85b7-1d005e362f1e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:44.281894 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e70fd6dd-0765-4846-85b7-1d005e362f1e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:44.282841 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e70fd6dd-0765-4846-85b7-1d005e362f1e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:44.285358 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=69 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:44.416662 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e70fd6dd-0765-4846-85b7-1d005e362f1e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:44.424798 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e70fd6dd-0765-4846-85b7-1d005e362f1e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.156729 Aug 10 23:28:44.425528 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 535/1076] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:44 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:28:45.446526 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b204cfe2-ab3b-473a-b339-0b1116983e1b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:45.447173 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b204cfe2-ab3b-473a-b339-0b1116983e1b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:45.449532 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:45.454670 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b204cfe2-ab3b-473a-b339-0b1116983e1b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:45.458829 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b204cfe2-ab3b-473a-b339-0b1116983e1b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:45.458829 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b204cfe2-ab3b-473a-b339-0b1116983e1b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:45.458829 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b204cfe2-ab3b-473a-b339-0b1116983e1b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:45.458829 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b204cfe2-ab3b-473a-b339-0b1116983e1b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:45.459227 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b204cfe2-ab3b-473a-b339-0b1116983e1b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:45.460325 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:45.593926 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b204cfe2-ab3b-473a-b339-0b1116983e1b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:45.603913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b204cfe2-ab3b-473a-b339-0b1116983e1b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.162840 Aug 10 23:28:45.607875 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 542/1077] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:45 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:46.625993 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8173231f-7b96-4d19-b566-217c11af22f5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:46.626610 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8173231f-7b96-4d19-b566-217c11af22f5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:46.633434 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8173231f-7b96-4d19-b566-217c11af22f5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:46.633924 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8173231f-7b96-4d19-b566-217c11af22f5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:46.634366 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8173231f-7b96-4d19-b566-217c11af22f5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:46.635101 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8173231f-7b96-4d19-b566-217c11af22f5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:46.635563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8173231f-7b96-4d19-b566-217c11af22f5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:46.636045 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8173231f-7b96-4d19-b566-217c11af22f5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:46.768723 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8173231f-7b96-4d19-b566-217c11af22f5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:46.776182 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8173231f-7b96-4d19-b566-217c11af22f5 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.154077 Aug 10 23:28:46.776789 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 536/1078] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:46 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:47.797191 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f41a2458-b478-4ae5-9faa-88fb75128fb7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:47.798031 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f41a2458-b478-4ae5-9faa-88fb75128fb7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:47.806625 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41a2458-b478-4ae5-9faa-88fb75128fb7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:47.807147 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41a2458-b478-4ae5-9faa-88fb75128fb7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:47.807632 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41a2458-b478-4ae5-9faa-88fb75128fb7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:47.808346 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41a2458-b478-4ae5-9faa-88fb75128fb7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:47.808802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41a2458-b478-4ae5-9faa-88fb75128fb7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:47.809230 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f41a2458-b478-4ae5-9faa-88fb75128fb7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:47.947564 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f41a2458-b478-4ae5-9faa-88fb75128fb7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:47.955524 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f41a2458-b478-4ae5-9faa-88fb75128fb7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.162168 Aug 10 23:28:47.956154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 543/1079] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:47 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:48.975701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e94870fc-7fae-44f6-9115-d896750ccb49 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:48.976349 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e94870fc-7fae-44f6-9115-d896750ccb49 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:48.982762 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e94870fc-7fae-44f6-9115-d896750ccb49 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:48.986128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e94870fc-7fae-44f6-9115-d896750ccb49 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:48.986128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e94870fc-7fae-44f6-9115-d896750ccb49 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:48.986128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e94870fc-7fae-44f6-9115-d896750ccb49 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:48.986128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e94870fc-7fae-44f6-9115-d896750ccb49 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:48.987072 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e94870fc-7fae-44f6-9115-d896750ccb49 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:49.124386 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e94870fc-7fae-44f6-9115-d896750ccb49 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:49.132799 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e94870fc-7fae-44f6-9115-d896750ccb49 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.160926 Aug 10 23:28:49.135568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 537/1080] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:48 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:49.311988 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-7263e54e-91bc-43ca-8479-31a6264817af req-0b7d879e-18a9-4a7a-ada6-d0025cf5b771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c344d4-3cad-4938-8631-f0320f44d333", "name": "network-vif-plugged", "status": "completed", "tag": "bbe68c6c-c2d2-4ac4-9443-f6a999af222f"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:49.323880 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7263e54e-91bc-43ca-8479-31a6264817af req-0b7d879e-18a9-4a7a-ada6-d0025cf5b771 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:49.324397 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7263e54e-91bc-43ca-8479-31a6264817af req-0b7d879e-18a9-4a7a-ada6-d0025cf5b771 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:49.324834 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7263e54e-91bc-43ca-8479-31a6264817af req-0b7d879e-18a9-4a7a-ada6-d0025cf5b771 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:49.336311 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-7263e54e-91bc-43ca-8479-31a6264817af req-0b7d879e-18a9-4a7a-ada6-d0025cf5b771 service nova] Creating event network-vif-plugged:bbe68c6c-c2d2-4ac4-9443-f6a999af222f for instance 47c344d4-3cad-4938-8631-f0320f44d333 on hv-cinder-85144 Aug 10 23:28:49.341633 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-7263e54e-91bc-43ca-8479-31a6264817af req-0b7d879e-18a9-4a7a-ada6-d0025cf5b771 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033503 Aug 10 23:28:49.342287 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 544/1081] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:28:50.153382 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-89c9e98b-add9-40d0-a726-31eec272f9e9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:50.154025 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-89c9e98b-add9-40d0-a726-31eec272f9e9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:50.160420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c9e98b-add9-40d0-a726-31eec272f9e9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:50.160906 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c9e98b-add9-40d0-a726-31eec272f9e9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:50.161340 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c9e98b-add9-40d0-a726-31eec272f9e9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:50.162026 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c9e98b-add9-40d0-a726-31eec272f9e9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:50.162475 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c9e98b-add9-40d0-a726-31eec272f9e9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:50.162919 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-89c9e98b-add9-40d0-a726-31eec272f9e9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:50.291684 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-89c9e98b-add9-40d0-a726-31eec272f9e9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:50.299208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-89c9e98b-add9-40d0-a726-31eec272f9e9 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.149639 Aug 10 23:28:50.299776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 538/1082] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:50 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:51.321138 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b9487ebd-8abf-425a-9018-aed67cf3a4ce tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:51.321825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b9487ebd-8abf-425a-9018-aed67cf3a4ce tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:51.327898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b9487ebd-8abf-425a-9018-aed67cf3a4ce tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:51.328373 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b9487ebd-8abf-425a-9018-aed67cf3a4ce tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:51.328805 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b9487ebd-8abf-425a-9018-aed67cf3a4ce tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:51.329762 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b9487ebd-8abf-425a-9018-aed67cf3a4ce tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:51.330747 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b9487ebd-8abf-425a-9018-aed67cf3a4ce tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:51.331172 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b9487ebd-8abf-425a-9018-aed67cf3a4ce tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:51.466632 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b9487ebd-8abf-425a-9018-aed67cf3a4ce tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:51.474794 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b9487ebd-8abf-425a-9018-aed67cf3a4ce tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1267 microversion: 2.1 time: 0.158350 Aug 10 23:28:51.475363 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 545/1083] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:51 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:52.495687 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-e17902f8-078b-4e51-8362-73c03e4c9992 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:52.496106 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-e17902f8-078b-4e51-8362-73c03e4c9992 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:52.502296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17902f8-078b-4e51-8362-73c03e4c9992 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:52.502819 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17902f8-078b-4e51-8362-73c03e4c9992 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:52.503258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17902f8-078b-4e51-8362-73c03e4c9992 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:52.504010 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17902f8-078b-4e51-8362-73c03e4c9992 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:52.504466 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17902f8-078b-4e51-8362-73c03e4c9992 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:52.504949 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-e17902f8-078b-4e51-8362-73c03e4c9992 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:52.678189 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-e17902f8-078b-4e51-8362-73c03e4c9992 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:52.686408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-e17902f8-078b-4e51-8362-73c03e4c9992 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1455 microversion: 2.1 time: 0.194924 Aug 10 23:28:52.687030 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 539/1084] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:52 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1455 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:28:52.707253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-6636590d-fc91-4728-a855-7b8ad9511b9f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:52.707865 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-6636590d-fc91-4728-a855-7b8ad9511b9f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:52.714086 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6636590d-fc91-4728-a855-7b8ad9511b9f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:52.714569 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6636590d-fc91-4728-a855-7b8ad9511b9f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:52.715036 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6636590d-fc91-4728-a855-7b8ad9511b9f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:52.715726 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6636590d-fc91-4728-a855-7b8ad9511b9f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:52.716206 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6636590d-fc91-4728-a855-7b8ad9511b9f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:52.716630 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-6636590d-fc91-4728-a855-7b8ad9511b9f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:52.888445 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-6636590d-fc91-4728-a855-7b8ad9511b9f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:52.896568 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-6636590d-fc91-4728-a855-7b8ad9511b9f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1455 microversion: 2.1 time: 0.193901 Aug 10 23:28:52.897146 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 546/1085] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:52 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1455 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:55.126047 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-b9878caa-ffc8-4479-9ee4-8e15660cc5ad req-511d1def-a35e-4ec1-96c7-5c915c5bc99c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c344d4-3cad-4938-8631-f0320f44d333", "tag": "bbe68c6c-c2d2-4ac4-9443-f6a999af222f"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:55.137458 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-b9878caa-ffc8-4479-9ee4-8e15660cc5ad req-511d1def-a35e-4ec1-96c7-5c915c5bc99c service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:55.137458 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-b9878caa-ffc8-4479-9ee4-8e15660cc5ad req-511d1def-a35e-4ec1-96c7-5c915c5bc99c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:55.137458 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-b9878caa-ffc8-4479-9ee4-8e15660cc5ad req-511d1def-a35e-4ec1-96c7-5c915c5bc99c service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:55.155451 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-b9878caa-ffc8-4479-9ee4-8e15660cc5ad req-511d1def-a35e-4ec1-96c7-5c915c5bc99c service nova] Creating event network-changed:bbe68c6c-c2d2-4ac4-9443-f6a999af222f for instance 47c344d4-3cad-4938-8631-f0320f44d333 on hv-cinder-85144 Aug 10 23:28:55.161362 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-b9878caa-ffc8-4479-9ee4-8e15660cc5ad req-511d1def-a35e-4ec1-96c7-5c915c5bc99c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038783 Aug 10 23:28:55.163972 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 540/1086] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:08.488850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-52994e1d-ce76-4992-86de-8501e15d8d4a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2078570890"}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:08.489416 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-52994e1d-ce76-4992-86de-8501e15d8d4a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:08.491864 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=9 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:08.492531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=25 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:08.497228 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52994e1d-ce76-4992-86de-8501e15d8d4a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:08.497717 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52994e1d-ce76-4992-86de-8501e15d8d4a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:08.498158 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52994e1d-ce76-4992-86de-8501e15d8d4a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:08.498900 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52994e1d-ce76-4992-86de-8501e15d8d4a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:08.499361 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52994e1d-ce76-4992-86de-8501e15d8d4a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:08.499791 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-52994e1d-ce76-4992-86de-8501e15d8d4a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:08.694462 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.network.security_group_api [None req-52994e1d-ce76-4992-86de-8501e15d8d4a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Removing security group cf83060d-2d00-4514-a764-2c66ef44f363 from port 68ea7c6e-43f1-4455-b812-68829f94092e Aug 10 23:29:09.234623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-52994e1d-ce76-4992-86de-8501e15d8d4a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "POST /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/action" status: 202 len: 0 microversion: 2.1 time: 0.750227 Aug 10 23:29:09.235528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 547/1087] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 10 23:29:08 2022] POST /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:29:09.246692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=11 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:09.247792 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=31 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:09.252170 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-4fce83d9-9ddc-4ebe-9dd6-c776b93ec48a req-22323dcc-10c7-47ae-8de0-bbb506c1e103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accccf1a-80e8-4e9e-b0fc-088c611c496e", "tag": "68ea7c6e-43f1-4455-b812-68829f94092e"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:09.263076 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-4fce83d9-9ddc-4ebe-9dd6-c776b93ec48a req-22323dcc-10c7-47ae-8de0-bbb506c1e103 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:09.263850 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-4fce83d9-9ddc-4ebe-9dd6-c776b93ec48a req-22323dcc-10c7-47ae-8de0-bbb506c1e103 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:09.264450 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-4fce83d9-9ddc-4ebe-9dd6-c776b93ec48a req-22323dcc-10c7-47ae-8de0-bbb506c1e103 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:09.277249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-4fce83d9-9ddc-4ebe-9dd6-c776b93ec48a req-22323dcc-10c7-47ae-8de0-bbb506c1e103 service nova] Creating event network-changed:68ea7c6e-43f1-4455-b812-68829f94092e for instance accccf1a-80e8-4e9e-b0fc-088c611c496e on hv-cinder-85144 Aug 10 23:29:09.285148 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-4fce83d9-9ddc-4ebe-9dd6-c776b93ec48a req-22323dcc-10c7-47ae-8de0-bbb506c1e103 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038440 Aug 10 23:29:09.292519 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 541/1088] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:10.801215 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c27963d3-3609-4241-bd24-c7ac2c367206 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:10.801769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c27963d3-3609-4241-bd24-c7ac2c367206 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:10.805438 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-7e1be595-dd27-4833-9381-22999b3b3a81 req-8f37cfb9-bad6-4bbe-8f85-021cb947313d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accccf1a-80e8-4e9e-b0fc-088c611c496e", "tag": "68ea7c6e-43f1-4455-b812-68829f94092e"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:10.813294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c27963d3-3609-4241-bd24-c7ac2c367206 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:10.813787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c27963d3-3609-4241-bd24-c7ac2c367206 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:10.817015 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c27963d3-3609-4241-bd24-c7ac2c367206 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:10.817015 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c27963d3-3609-4241-bd24-c7ac2c367206 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:10.817015 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c27963d3-3609-4241-bd24-c7ac2c367206 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:10.817481 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-7e1be595-dd27-4833-9381-22999b3b3a81 req-8f37cfb9-bad6-4bbe-8f85-021cb947313d service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:10.817632 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c27963d3-3609-4241-bd24-c7ac2c367206 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:10.817739 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-7e1be595-dd27-4833-9381-22999b3b3a81 req-8f37cfb9-bad6-4bbe-8f85-021cb947313d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:10.817739 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-7e1be595-dd27-4833-9381-22999b3b3a81 req-8f37cfb9-bad6-4bbe-8f85-021cb947313d service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:10.828082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-7e1be595-dd27-4833-9381-22999b3b3a81 req-8f37cfb9-bad6-4bbe-8f85-021cb947313d service nova] Creating event network-changed:68ea7c6e-43f1-4455-b812-68829f94092e for instance accccf1a-80e8-4e9e-b0fc-088c611c496e on hv-cinder-85144 Aug 10 23:29:10.834323 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-7e1be595-dd27-4833-9381-22999b3b3a81 req-8f37cfb9-bad6-4bbe-8f85-021cb947313d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034220 Aug 10 23:29:10.835536 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 542/1089] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:29:10.930373 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-c27963d3-3609-4241-bd24-c7ac2c367206 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lazy-loading 'services' on Instance uuid accccf1a-80e8-4e9e-b0fc-088c611c496e {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:29:11.186417 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c27963d3-3609-4241-bd24-c7ac2c367206 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "DELETE /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments/dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86" status: 202 len: 0 microversion: 2.1 time: 0.389898 Aug 10 23:29:11.187099 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 548/1090] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:29:10 2022] DELETE /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments/dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:29:11.197628 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-013674fa-6a01-49e6-9b33-b12241a41b3a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:11.201488 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-013674fa-6a01-49e6-9b33-b12241a41b3a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:11.210760 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-013674fa-6a01-49e6-9b33-b12241a41b3a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:11.211553 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-013674fa-6a01-49e6-9b33-b12241a41b3a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:11.212130 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-013674fa-6a01-49e6-9b33-b12241a41b3a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:11.212980 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-013674fa-6a01-49e6-9b33-b12241a41b3a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:11.213506 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-013674fa-6a01-49e6-9b33-b12241a41b3a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:11.214141 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-013674fa-6a01-49e6-9b33-b12241a41b3a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:11.246065 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-013674fa-6a01-49e6-9b33-b12241a41b3a tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052839 Aug 10 23:29:11.246642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 543/1091] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:29:11 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:12.067414 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-702808807", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "networks": [{"uuid": "1cd08d29-3270-4ca5-ae77-90228d96ab73"}]}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:12.124703 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.network.neutron [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] validate_networks() for [('1cd08d29-3270-4ca5-ae77-90228d96ab73', None, None, None, None, None)] {{(pid=121332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:29:12.257832 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-446593dc-bafa-48bf-b8c7-912ac6be6e1c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:12.260088 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-446593dc-bafa-48bf-b8c7-912ac6be6e1c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:12.266553 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-446593dc-bafa-48bf-b8c7-912ac6be6e1c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:12.267078 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-446593dc-bafa-48bf-b8c7-912ac6be6e1c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:12.267551 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-446593dc-bafa-48bf-b8c7-912ac6be6e1c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:12.268501 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-446593dc-bafa-48bf-b8c7-912ac6be6e1c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:12.269594 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-446593dc-bafa-48bf-b8c7-912ac6be6e1c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:12.270023 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-446593dc-bafa-48bf-b8c7-912ac6be6e1c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:12.298723 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-446593dc-bafa-48bf-b8c7-912ac6be6e1c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Aug 10 23:29:12.299509 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 544/1092] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:29:12 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:29:12.472250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Flavor limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:29:12.472822 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Image limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:29:12.473291 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Flavor pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:29:12.473700 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Image pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:29:12.474140 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:29:12.483358 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:12.483832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:12.484261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:12.484977 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:12.485424 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:12.485843 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:12.502455 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Getting quotas for project 76c66a7fe733409a88b4584a7e10bb4f. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:29:12.507125 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Getting quotas for user 892815f6b41f4ec3acb52275ace9a172 and project 76c66a7fe733409a88b4584a7e10bb4f. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:29:12.517995 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Going to run 1 instances... {{(pid=121332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:29:12.520949 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:29:12.671989 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-9dc89d69-bf01-4c2f-99bd-1e63a512693c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609323 Aug 10 23:29:12.672560 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 549/1093] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:29:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:29:12.683871 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-62c81432-9361-49fc-8551-bfef956095a1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:12.684483 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-62c81432-9361-49fc-8551-bfef956095a1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:12.739015 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-62c81432-9361-49fc-8551-bfef956095a1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:12.745776 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-62c81432-9361-49fc-8551-bfef956095a1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1218 microversion: 2.1 time: 0.065712 Aug 10 23:29:12.759165 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 545/1094] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:12 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:13.310871 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-0760933c-6b6b-4f39-b7dd-131087d8d54e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:13.313106 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-0760933c-6b6b-4f39-b7dd-131087d8d54e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:13.319567 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0760933c-6b6b-4f39-b7dd-131087d8d54e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:13.320051 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0760933c-6b6b-4f39-b7dd-131087d8d54e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:13.320487 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0760933c-6b6b-4f39-b7dd-131087d8d54e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:13.321238 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0760933c-6b6b-4f39-b7dd-131087d8d54e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:13.321691 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0760933c-6b6b-4f39-b7dd-131087d8d54e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:13.322121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-0760933c-6b6b-4f39-b7dd-131087d8d54e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:13.352107 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-0760933c-6b6b-4f39-b7dd-131087d8d54e tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045848 Aug 10 23:29:13.352666 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 550/1095] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 10 23:29:13 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:29:13.363848 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:13.364396 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:13.371774 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:13.372633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:13.372875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:13.373392 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:13.373853 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:13.374285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:13.453728 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] HTTP exception thrown: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e is not attached to volume dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86 Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Request method failure captured: Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: DELETE /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments/dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86 HTTP/1.1 Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D5y67iDOeigDEsMgz6vURFSGs2TuGx1pZCeNdw2PiPWc1gJz40nYzMRr80a8s8wgS4KbF3Zoy5hBSUwurN_3-amamtPQnER3kA7r-WRc2BLTq5it519ZSyQskQgFdjEmHIbdeG3IOsewRSq98cxwek0psKu_wt9gU6Uasps-mP5fgA Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 1fbc9fef5e46490da9e1142d70e04228 Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-TestMinimumBasicScenario-815965858 Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:29:13.456242 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1fbc9fef5e46490da9e1142d70e04228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1fbc9fef5e46490da9e1142d70e04228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1fbc9fef5e46490da9e1142d70e04228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1fbc9fef5e46490da9e1142d70e04228", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-TestMinimumBasicScenario-815965858 Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 1fbc9fef5e46490da9e1142d70e04228 Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-TestMinimumBasicScenario-815965858 Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-TestMinimumBasicScenario-815965858-project Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: ef47061e975849c6ab4054f380f8527c Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-TestMinimumBasicScenario-815965858-project Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:29:13.458633 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e is not attached to volume dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86 Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'server_id': 'accccf1a-80e8-4e9e-b0fc-088c611c496e', 'id': 'dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86'} Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86. Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:29:13.459666 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e is not attached to volume dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86 Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e is not attached to volume dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86 Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:29:13.461310 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Returning 404 to user: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e is not attached to volume dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86 {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:29:13.463184 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f5f1dc46-8896-4788-8ffb-bd5d739b76cd tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "DELETE /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments/dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86" status: 404 len: 154 microversion: 2.1 time: 0.098401 Aug 10 23:29:13.463184 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 546/1096] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:29:13 2022] DELETE /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e/os-volume_attachments/dfb4e35d-d9ff-400d-a8c4-ad0ee7a4ce86 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:29:13.766684 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-26d0eef0-e027-4508-a50d-66749e48c9ba tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:13.767605 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-26d0eef0-e027-4508-a50d-66749e48c9ba tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:13.827523 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-26d0eef0-e027-4508-a50d-66749e48c9ba tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:13.835067 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-26d0eef0-e027-4508-a50d-66749e48c9ba tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1218 microversion: 2.1 time: 0.072269 Aug 10 23:29:13.835624 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 551/1097] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:13 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:14.833397 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-eae00139-9eb6-46b4-a1a7-4b6c6de58167 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:14.833916 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-eae00139-9eb6-46b4-a1a7-4b6c6de58167 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:14.840301 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eae00139-9eb6-46b4-a1a7-4b6c6de58167 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.840778 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eae00139-9eb6-46b4-a1a7-4b6c6de58167 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.841210 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eae00139-9eb6-46b4-a1a7-4b6c6de58167 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.841905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eae00139-9eb6-46b4-a1a7-4b6c6de58167 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.842350 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eae00139-9eb6-46b4-a1a7-4b6c6de58167 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.842794 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-eae00139-9eb6-46b4-a1a7-4b6c6de58167 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.856132 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f5355ff8-9b68-4a90-8227-2a6e43d8f702 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:14.856728 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f5355ff8-9b68-4a90-8227-2a6e43d8f702 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:14.863697 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5355ff8-9b68-4a90-8227-2a6e43d8f702 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.864172 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5355ff8-9b68-4a90-8227-2a6e43d8f702 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.864602 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5355ff8-9b68-4a90-8227-2a6e43d8f702 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.865291 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5355ff8-9b68-4a90-8227-2a6e43d8f702 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.865740 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5355ff8-9b68-4a90-8227-2a6e43d8f702 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.866160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f5355ff8-9b68-4a90-8227-2a6e43d8f702 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.871189 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-eae00139-9eb6-46b4-a1a7-4b6c6de58167 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Going to try to terminate instance {{(pid=121333) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:29:15.181160 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-eae00139-9eb6-46b4-a1a7-4b6c6de58167 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "DELETE /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 204 len: 0 microversion: 2.1 time: 0.352119 Aug 10 23:29:15.181878 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 547/1098] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:29:14 2022] DELETE /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:29:15.190528 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-53c61d3d-9d8f-4421-852e-86ae9d92b938 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:15.191763 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-53c61d3d-9d8f-4421-852e-86ae9d92b938 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:15.192436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f5355ff8-9b68-4a90-8227-2a6e43d8f702 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:15.198147 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53c61d3d-9d8f-4421-852e-86ae9d92b938 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:15.198635 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53c61d3d-9d8f-4421-852e-86ae9d92b938 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:15.199214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53c61d3d-9d8f-4421-852e-86ae9d92b938 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:15.199921 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53c61d3d-9d8f-4421-852e-86ae9d92b938 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:15.200370 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53c61d3d-9d8f-4421-852e-86ae9d92b938 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:15.200785 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-53c61d3d-9d8f-4421-852e-86ae9d92b938 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:15.201766 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f5355ff8-9b68-4a90-8227-2a6e43d8f702 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1270 microversion: 2.1 time: 0.349478 Aug 10 23:29:15.202346 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 552/1099] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:14 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1270 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:29:15.377382 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-53c61d3d-9d8f-4421-852e-86ae9d92b938 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:15.385649 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-53c61d3d-9d8f-4421-852e-86ae9d92b938 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1553 microversion: 2.1 time: 0.199265 Aug 10 23:29:15.386209 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 548/1100] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:15 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:29:16.228735 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-48195a51-40e5-4f1f-8987-a65fd109bcd2 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:16.229351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-48195a51-40e5-4f1f-8987-a65fd109bcd2 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:16.235868 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48195a51-40e5-4f1f-8987-a65fd109bcd2 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:16.236355 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48195a51-40e5-4f1f-8987-a65fd109bcd2 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:16.236792 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48195a51-40e5-4f1f-8987-a65fd109bcd2 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:16.237513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48195a51-40e5-4f1f-8987-a65fd109bcd2 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:16.237967 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48195a51-40e5-4f1f-8987-a65fd109bcd2 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:16.238394 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-48195a51-40e5-4f1f-8987-a65fd109bcd2 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:16.299135 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-48195a51-40e5-4f1f-8987-a65fd109bcd2 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:16.307054 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-48195a51-40e5-4f1f-8987-a65fd109bcd2 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1288 microversion: 2.1 time: 0.082377 Aug 10 23:29:16.307621 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 553/1101] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:16 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:29:16.407082 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-23d0e897-29bb-4aed-942e-dc805a238b1f tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:16.407701 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-23d0e897-29bb-4aed-942e-dc805a238b1f tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:16.414213 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d0e897-29bb-4aed-942e-dc805a238b1f tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:16.414729 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d0e897-29bb-4aed-942e-dc805a238b1f tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:16.415167 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d0e897-29bb-4aed-942e-dc805a238b1f tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:16.415862 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d0e897-29bb-4aed-942e-dc805a238b1f tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:16.416320 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d0e897-29bb-4aed-942e-dc805a238b1f tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:16.416746 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-23d0e897-29bb-4aed-942e-dc805a238b1f tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:16.549116 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-23d0e897-29bb-4aed-942e-dc805a238b1f tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:16.557128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-23d0e897-29bb-4aed-942e-dc805a238b1f tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1553 microversion: 2.1 time: 0.153920 Aug 10 23:29:16.557697 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 549/1102] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:16 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:17.328589 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-689aec52-f4b1-4c91-b176-682f6374a75f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:17.329211 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-689aec52-f4b1-4c91-b176-682f6374a75f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:17.336240 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-689aec52-f4b1-4c91-b176-682f6374a75f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.336730 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-689aec52-f4b1-4c91-b176-682f6374a75f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.337167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-689aec52-f4b1-4c91-b176-682f6374a75f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.337872 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-689aec52-f4b1-4c91-b176-682f6374a75f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.338360 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-689aec52-f4b1-4c91-b176-682f6374a75f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.338777 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-689aec52-f4b1-4c91-b176-682f6374a75f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.458898 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-689aec52-f4b1-4c91-b176-682f6374a75f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:17.461468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-689aec52-f4b1-4c91-b176-682f6374a75f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1276 microversion: 2.1 time: 0.137024 Aug 10 23:29:17.462038 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 554/1103] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:17 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:17.579411 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-053ea37a-c33c-458e-8a92-066e49febe59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:17.579980 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-053ea37a-c33c-458e-8a92-066e49febe59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:17.587386 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-053ea37a-c33c-458e-8a92-066e49febe59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.587875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-053ea37a-c33c-458e-8a92-066e49febe59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.588313 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-053ea37a-c33c-458e-8a92-066e49febe59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.589014 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-053ea37a-c33c-458e-8a92-066e49febe59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.589467 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-053ea37a-c33c-458e-8a92-066e49febe59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.589893 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-053ea37a-c33c-458e-8a92-066e49febe59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.811119 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-053ea37a-c33c-458e-8a92-066e49febe59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:17.823152 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-053ea37a-c33c-458e-8a92-066e49febe59 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1553 microversion: 2.1 time: 0.244514 Aug 10 23:29:17.823152 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 550/1104] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:17 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:18.078011 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-7361b5e2-9706-40c5-b020-6f4a89ddd5e5 req-45bacf1f-ff74-485e-9812-9d9e7f239d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accccf1a-80e8-4e9e-b0fc-088c611c496e", "name": "network-vif-deleted", "tag": "68ea7c6e-43f1-4455-b812-68829f94092e"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:18.088150 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7361b5e2-9706-40c5-b020-6f4a89ddd5e5 req-45bacf1f-ff74-485e-9812-9d9e7f239d9b service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.088558 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7361b5e2-9706-40c5-b020-6f4a89ddd5e5 req-45bacf1f-ff74-485e-9812-9d9e7f239d9b service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.088997 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-7361b5e2-9706-40c5-b020-6f4a89ddd5e5 req-45bacf1f-ff74-485e-9812-9d9e7f239d9b service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.101473 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-7361b5e2-9706-40c5-b020-6f4a89ddd5e5 req-45bacf1f-ff74-485e-9812-9d9e7f239d9b service nova] Creating event network-vif-deleted:68ea7c6e-43f1-4455-b812-68829f94092e for instance accccf1a-80e8-4e9e-b0fc-088c611c496e on hv-cinder-85144 Aug 10 23:29:18.106601 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-7361b5e2-9706-40c5-b020-6f4a89ddd5e5 req-45bacf1f-ff74-485e-9812-9d9e7f239d9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034132 Aug 10 23:29:18.107282 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 555/1105] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:18.492474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-956aa1ba-7a50-4cae-8099-aec13aa874dd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:18.492474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-956aa1ba-7a50-4cae-8099-aec13aa874dd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:18.492474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-956aa1ba-7a50-4cae-8099-aec13aa874dd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.492474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-956aa1ba-7a50-4cae-8099-aec13aa874dd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.492939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-956aa1ba-7a50-4cae-8099-aec13aa874dd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.492939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-956aa1ba-7a50-4cae-8099-aec13aa874dd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.492939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-956aa1ba-7a50-4cae-8099-aec13aa874dd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.492939 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-956aa1ba-7a50-4cae-8099-aec13aa874dd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.691677 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-956aa1ba-7a50-4cae-8099-aec13aa874dd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:18.699244 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-956aa1ba-7a50-4cae-8099-aec13aa874dd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1318 microversion: 2.1 time: 0.221740 Aug 10 23:29:18.700009 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 551/1106] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:18 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:18.841871 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:18.842771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:18.850628 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.851145 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.851585 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.852388 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.852792 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.853221 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.884736 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.885223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.885665 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.886118 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lazy-loading 'fault' on Instance uuid accccf1a-80e8-4e9e-b0fc-088c611c496e {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:29:18.932406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef47061e975849c6ab4054f380f8527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbc9fef5e46490da9e1142d70e04228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:18.939993 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-828a0ad9-d6b5-4927-a822-e8d098a9f997 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 200 len: 1346 microversion: 2.1 time: 0.102680 Aug 10 23:29:18.941101 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 556/1107] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:18 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:19.720716 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b0d497a4-1eba-4d3f-9162-82628f63ce87 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:19.721270 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b0d497a4-1eba-4d3f-9162-82628f63ce87 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:19.727769 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0d497a4-1eba-4d3f-9162-82628f63ce87 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:19.730237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0d497a4-1eba-4d3f-9162-82628f63ce87 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:19.730237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0d497a4-1eba-4d3f-9162-82628f63ce87 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:19.730237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0d497a4-1eba-4d3f-9162-82628f63ce87 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:19.730237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0d497a4-1eba-4d3f-9162-82628f63ce87 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:19.730646 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b0d497a4-1eba-4d3f-9162-82628f63ce87 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:19.863239 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b0d497a4-1eba-4d3f-9162-82628f63ce87 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:19.870710 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b0d497a4-1eba-4d3f-9162-82628f63ce87 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1318 microversion: 2.1 time: 0.153966 Aug 10 23:29:19.871285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 552/1108] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:19 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:19.964579 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:19.965197 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] [instance: accccf1a-80e8-4e9e-b0fc-088c611c496e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:19.971569 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:19.972181 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:19.972431 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:19.973122 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:19.973577 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:19.974003 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:19.989132 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] HTTP exception thrown: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e could not be found. Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Request method failure captured: Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e HTTP/1.1 Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D5y67iDOeigDEsMgz6vURFSGs2TuGx1pZCeNdw2PiPWc1gJz40nYzMRr80a8s8wgS4KbF3Zoy5hBSUwurN_3-amamtPQnER3kA7r-WRc2BLTq5it519ZSyQskQgFdjEmHIbdeG3IOsewRSq98cxwek0psKu_wt9gU6Uasps-mP5fgA Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 1fbc9fef5e46490da9e1142d70e04228 Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-TestMinimumBasicScenario-815965858 Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:29:19.990813 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1fbc9fef5e46490da9e1142d70e04228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1fbc9fef5e46490da9e1142d70e04228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1fbc9fef5e46490da9e1142d70e04228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1fbc9fef5e46490da9e1142d70e04228", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-TestMinimumBasicScenario-815965858 Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 1fbc9fef5e46490da9e1142d70e04228 Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-TestMinimumBasicScenario-815965858 Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-TestMinimumBasicScenario-815965858-project Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: ef47061e975849c6ab4054f380f8527c Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-TestMinimumBasicScenario-815965858-project Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e could not be found. Aug 10 23:29:19.993258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'accccf1a-80e8-4e9e-b0fc-088c611c496e'} Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e could not be found. Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:29:19.994396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e could not be found. Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e could not be found. Aug 10 23:29:19.999818 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:29:20.001349 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Returning 404 to user: Instance accccf1a-80e8-4e9e-b0fc-088c611c496e could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:29:20.001349 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7e9fa022-46da-4ab7-95cc-bca2642cbea2 tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e" status: 404 len: 111 microversion: 2.1 time: 0.031526 Aug 10 23:29:20.001349 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 557/1109] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:19 2022] GET /compute/v2.1/servers/accccf1a-80e8-4e9e-b0fc-088c611c496e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:29:20.001635 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d06074ff-4b81-442b-818a-be61edf5982c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] Calling method '.version_select at 0x7fe8404d6790>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:20.078626 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d06074ff-4b81-442b-818a-be61edf5982c tempest-TestMinimumBasicScenario-815965858 tempest-TestMinimumBasicScenario-815965858-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-323430405" status: 202 len: 0 microversion: 2.1 time: 0.081180 Aug 10 23:29:20.079247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 553/1110] 10.222.0.78 () {58 vars in 1269 bytes} [Wed Aug 10 23:29:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-323430405 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:29:20.247642 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-2e0f49a5-3628-416d-a638-29e35692a458 req-1a867f23-412c-484d-b9d3-265c9988c4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5d888aa-c703-4e3b-b9a7-9fdeb9416957", "tag": "5ee4f602-378b-4a47-938f-9e415882fde4"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:20.257153 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-2e0f49a5-3628-416d-a638-29e35692a458 req-1a867f23-412c-484d-b9d3-265c9988c4de service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:20.257701 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-2e0f49a5-3628-416d-a638-29e35692a458 req-1a867f23-412c-484d-b9d3-265c9988c4de service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:20.258222 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-2e0f49a5-3628-416d-a638-29e35692a458 req-1a867f23-412c-484d-b9d3-265c9988c4de service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:20.270159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-2e0f49a5-3628-416d-a638-29e35692a458 req-1a867f23-412c-484d-b9d3-265c9988c4de service nova] Creating event network-changed:5ee4f602-378b-4a47-938f-9e415882fde4 for instance b5d888aa-c703-4e3b-b9a7-9fdeb9416957 on hv-cinder-85144 Aug 10 23:29:20.274969 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-2e0f49a5-3628-416d-a638-29e35692a458 req-1a867f23-412c-484d-b9d3-265c9988c4de service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156508 Aug 10 23:29:20.275553 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 558/1111] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:29:20.891914 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-d3e6eb55-6018-447c-b622-11453222e843 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:20.892656 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-d3e6eb55-6018-447c-b622-11453222e843 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:20.899175 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3e6eb55-6018-447c-b622-11453222e843 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:20.899665 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3e6eb55-6018-447c-b622-11453222e843 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:20.900104 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3e6eb55-6018-447c-b622-11453222e843 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:20.900812 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3e6eb55-6018-447c-b622-11453222e843 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:20.901300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3e6eb55-6018-447c-b622-11453222e843 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:20.901875 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-d3e6eb55-6018-447c-b622-11453222e843 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:21.033800 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-d3e6eb55-6018-447c-b622-11453222e843 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:21.041267 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-d3e6eb55-6018-447c-b622-11453222e843 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1318 microversion: 2.1 time: 0.153249 Aug 10 23:29:21.041832 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 554/1112] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:20 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:22.063070 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-3b31e7b3-1611-4f00-9137-87ca0dba9645 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:22.064082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-3b31e7b3-1611-4f00-9137-87ca0dba9645 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:22.071769 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b31e7b3-1611-4f00-9137-87ca0dba9645 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:22.072360 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b31e7b3-1611-4f00-9137-87ca0dba9645 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:22.078751 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b31e7b3-1611-4f00-9137-87ca0dba9645 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:22.078751 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b31e7b3-1611-4f00-9137-87ca0dba9645 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:22.078751 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b31e7b3-1611-4f00-9137-87ca0dba9645 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:22.078751 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-3b31e7b3-1611-4f00-9137-87ca0dba9645 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:22.207372 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-3b31e7b3-1611-4f00-9137-87ca0dba9645 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:22.215099 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-3b31e7b3-1611-4f00-9137-87ca0dba9645 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1318 microversion: 2.1 time: 0.156703 Aug 10 23:29:22.215664 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 559/1113] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:22 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:23.236111 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6f04dd95-c1cb-44f4-8fd7-e94459a9f22b tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:23.236920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6f04dd95-c1cb-44f4-8fd7-e94459a9f22b tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:23.240153 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:23.245249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f04dd95-c1cb-44f4-8fd7-e94459a9f22b tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:23.245890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f04dd95-c1cb-44f4-8fd7-e94459a9f22b tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:23.246437 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f04dd95-c1cb-44f4-8fd7-e94459a9f22b tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:23.247309 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f04dd95-c1cb-44f4-8fd7-e94459a9f22b tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:23.247882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f04dd95-c1cb-44f4-8fd7-e94459a9f22b tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:23.248413 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6f04dd95-c1cb-44f4-8fd7-e94459a9f22b tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:23.417186 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6f04dd95-c1cb-44f4-8fd7-e94459a9f22b tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:23.425064 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6f04dd95-c1cb-44f4-8fd7-e94459a9f22b tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1318 microversion: 2.1 time: 0.193028 Aug 10 23:29:23.431928 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 555/1114] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:23 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:24.445559 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-82495b5e-0b11-4548-ad1e-0cd89663152d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:24.446182 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-82495b5e-0b11-4548-ad1e-0cd89663152d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:24.448384 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:24.449814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=8 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:24.455020 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82495b5e-0b11-4548-ad1e-0cd89663152d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:24.455510 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82495b5e-0b11-4548-ad1e-0cd89663152d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:24.455984 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82495b5e-0b11-4548-ad1e-0cd89663152d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:24.456701 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82495b5e-0b11-4548-ad1e-0cd89663152d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:24.457158 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82495b5e-0b11-4548-ad1e-0cd89663152d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:24.457591 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-82495b5e-0b11-4548-ad1e-0cd89663152d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:24.962838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-82495b5e-0b11-4548-ad1e-0cd89663152d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:24.970266 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-82495b5e-0b11-4548-ad1e-0cd89663152d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1318 microversion: 2.1 time: 0.528761 Aug 10 23:29:24.970858 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 560/1115] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:24 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:25.604062 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-02ade182-9175-433e-8366-c022ca20e00e req-5abbba87-6183-4407-b2e0-26bcd78d6cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d888aa-c703-4e3b-b9a7-9fdeb9416957", "name": "network-vif-plugged", "status": "completed", "tag": "5ee4f602-378b-4a47-938f-9e415882fde4"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:25.616002 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-02ade182-9175-433e-8366-c022ca20e00e req-5abbba87-6183-4407-b2e0-26bcd78d6cb6 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:25.622271 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-02ade182-9175-433e-8366-c022ca20e00e req-5abbba87-6183-4407-b2e0-26bcd78d6cb6 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:25.622271 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-02ade182-9175-433e-8366-c022ca20e00e req-5abbba87-6183-4407-b2e0-26bcd78d6cb6 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:25.629238 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-02ade182-9175-433e-8366-c022ca20e00e req-5abbba87-6183-4407-b2e0-26bcd78d6cb6 service nova] Creating event network-vif-plugged:5ee4f602-378b-4a47-938f-9e415882fde4 for instance b5d888aa-c703-4e3b-b9a7-9fdeb9416957 on hv-cinder-85144 Aug 10 23:29:25.635292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-02ade182-9175-433e-8366-c022ca20e00e req-5abbba87-6183-4407-b2e0-26bcd78d6cb6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034989 Aug 10 23:29:25.635897 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 556/1116] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:25.992901 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cbc89127-68a3-41cc-b14e-3e95e437ed25 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:25.993524 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cbc89127-68a3-41cc-b14e-3e95e437ed25 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:25.999814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cbc89127-68a3-41cc-b14e-3e95e437ed25 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:26.000293 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cbc89127-68a3-41cc-b14e-3e95e437ed25 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:26.000727 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cbc89127-68a3-41cc-b14e-3e95e437ed25 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:26.001468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cbc89127-68a3-41cc-b14e-3e95e437ed25 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:26.001921 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cbc89127-68a3-41cc-b14e-3e95e437ed25 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:26.002346 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cbc89127-68a3-41cc-b14e-3e95e437ed25 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:26.147087 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cbc89127-68a3-41cc-b14e-3e95e437ed25 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:26.154838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cbc89127-68a3-41cc-b14e-3e95e437ed25 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1318 microversion: 2.1 time: 0.166049 Aug 10 23:29:26.155430 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 561/1117] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:25 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:27.177292 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8dc630d5-8a31-4236-b4be-f27c596ab943 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:27.178768 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8dc630d5-8a31-4236-b4be-f27c596ab943 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:27.185322 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8dc630d5-8a31-4236-b4be-f27c596ab943 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:27.185969 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8dc630d5-8a31-4236-b4be-f27c596ab943 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:27.186475 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8dc630d5-8a31-4236-b4be-f27c596ab943 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:27.187420 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8dc630d5-8a31-4236-b4be-f27c596ab943 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:27.187867 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8dc630d5-8a31-4236-b4be-f27c596ab943 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:27.188283 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8dc630d5-8a31-4236-b4be-f27c596ab943 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:27.335452 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-8dc630d5-8a31-4236-b4be-f27c596ab943 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:27.342983 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8dc630d5-8a31-4236-b4be-f27c596ab943 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1318 microversion: 2.1 time: 0.170870 Aug 10 23:29:27.343566 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 557/1118] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:27 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:28.365618 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5803f87c-1fc7-4c05-b910-7394336c9872 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:28.366850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5803f87c-1fc7-4c05-b910-7394336c9872 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:28.384555 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5803f87c-1fc7-4c05-b910-7394336c9872 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:28.385053 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5803f87c-1fc7-4c05-b910-7394336c9872 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:28.385701 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5803f87c-1fc7-4c05-b910-7394336c9872 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:28.386432 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5803f87c-1fc7-4c05-b910-7394336c9872 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:28.386986 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5803f87c-1fc7-4c05-b910-7394336c9872 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:28.387419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5803f87c-1fc7-4c05-b910-7394336c9872 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:28.549077 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5803f87c-1fc7-4c05-b910-7394336c9872 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:28.558073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5803f87c-1fc7-4c05-b910-7394336c9872 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1506 microversion: 2.1 time: 0.197220 Aug 10 23:29:28.558685 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 562/1119] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:28 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:50.389453 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-25b08cd2-7626-416e-8997-3a1e56350c5f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54d975bc-d7aa-423b-82f3-2343974f528d", "device": "/dev/sdb"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:50.392317 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-25b08cd2-7626-416e-8997-3a1e56350c5f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:50.394632 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:50.395316 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:50.400664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-25b08cd2-7626-416e-8997-3a1e56350c5f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:50.401148 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-25b08cd2-7626-416e-8997-3a1e56350c5f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:50.401590 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-25b08cd2-7626-416e-8997-3a1e56350c5f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:50.402298 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-25b08cd2-7626-416e-8997-3a1e56350c5f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:50.402876 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-25b08cd2-7626-416e-8997-3a1e56350c5f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:50.403290 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-25b08cd2-7626-416e-8997-3a1e56350c5f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:51.547563 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-25b08cd2-7626-416e-8997-3a1e56350c5f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "POST /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.161913 Aug 10 23:29:51.548249 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 558/1120] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:29:50 2022] POST /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957/os-volume_attachments => generated 194 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:19.319957 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-45063fb5-29db-4665-b932-f49885135059 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:19.320528 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-45063fb5-29db-4665-b932-f49885135059 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:19.322514 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:19.323205 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:19.328669 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-45063fb5-29db-4665-b932-f49885135059 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:19.329151 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-45063fb5-29db-4665-b932-f49885135059 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:19.329590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-45063fb5-29db-4665-b932-f49885135059 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:19.330286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-45063fb5-29db-4665-b932-f49885135059 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:19.330770 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-45063fb5-29db-4665-b932-f49885135059 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:19.331197 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-45063fb5-29db-4665-b932-f49885135059 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:19.412301 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-45063fb5-29db-4665-b932-f49885135059 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lazy-loading 'services' on Instance uuid b5d888aa-c703-4e3b-b9a7-9fdeb9416957 {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:30:19.652468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-45063fb5-29db-4665-b932-f49885135059 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957/os-volume_attachments/54d975bc-d7aa-423b-82f3-2343974f528d" status: 202 len: 0 microversion: 2.1 time: 0.336446 Aug 10 23:30:19.653082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 563/1121] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:30:19 2022] DELETE /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957/os-volume_attachments/54d975bc-d7aa-423b-82f3-2343974f528d => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:30:20.770017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:20.771001 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:20.775313 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-05a701d9-2fc8-40cc-bb35-50c97a125ddf tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:20.775826 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-05a701d9-2fc8-40cc-bb35-50c97a125ddf tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:20.782676 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05a701d9-2fc8-40cc-bb35-50c97a125ddf tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:20.783178 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05a701d9-2fc8-40cc-bb35-50c97a125ddf tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:20.783621 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05a701d9-2fc8-40cc-bb35-50c97a125ddf tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:20.784327 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05a701d9-2fc8-40cc-bb35-50c97a125ddf tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:20.784787 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05a701d9-2fc8-40cc-bb35-50c97a125ddf tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:20.785219 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-05a701d9-2fc8-40cc-bb35-50c97a125ddf tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:20.811237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-05a701d9-2fc8-40cc-bb35-50c97a125ddf tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Going to try to terminate instance {{(pid=121333) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:30:21.202018 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-05a701d9-2fc8-40cc-bb35-50c97a125ddf tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 204 len: 0 microversion: 2.1 time: 0.432940 Aug 10 23:30:21.202634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 559/1122] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:30:20 2022] DELETE /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:30:21.212366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5276a548-f60c-4d61-8c32-fea2ccf0962d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:21.218732 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5276a548-f60c-4d61-8c32-fea2ccf0962d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:21.220352 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5276a548-f60c-4d61-8c32-fea2ccf0962d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:21.220832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5276a548-f60c-4d61-8c32-fea2ccf0962d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:21.221274 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5276a548-f60c-4d61-8c32-fea2ccf0962d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:21.222012 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5276a548-f60c-4d61-8c32-fea2ccf0962d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:21.222469 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5276a548-f60c-4d61-8c32-fea2ccf0962d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:21.222923 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5276a548-f60c-4d61-8c32-fea2ccf0962d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:21.358895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-5276a548-f60c-4d61-8c32-fea2ccf0962d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:21.366304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5276a548-f60c-4d61-8c32-fea2ccf0962d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1512 microversion: 2.1 time: 0.159052 Aug 10 23:30:21.366896 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 564/1123] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:21 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:22.387108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-67d76049-d4d1-401b-a40f-bd260cdcbcc6 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:22.387802 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-67d76049-d4d1-401b-a40f-bd260cdcbcc6 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:22.394143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67d76049-d4d1-401b-a40f-bd260cdcbcc6 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:22.394609 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67d76049-d4d1-401b-a40f-bd260cdcbcc6 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:22.395074 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67d76049-d4d1-401b-a40f-bd260cdcbcc6 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:22.395767 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67d76049-d4d1-401b-a40f-bd260cdcbcc6 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:22.396208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67d76049-d4d1-401b-a40f-bd260cdcbcc6 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:22.396629 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-67d76049-d4d1-401b-a40f-bd260cdcbcc6 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:22.532595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-67d76049-d4d1-401b-a40f-bd260cdcbcc6 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:22.540128 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-67d76049-d4d1-401b-a40f-bd260cdcbcc6 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1512 microversion: 2.1 time: 0.157386 Aug 10 23:30:22.540699 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 560/1124] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:22 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:23.562073 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-50da2441-423c-4f84-b74b-0a65a8da90fd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:23.562715 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-50da2441-423c-4f84-b74b-0a65a8da90fd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:23.569160 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-50da2441-423c-4f84-b74b-0a65a8da90fd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:23.569708 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-50da2441-423c-4f84-b74b-0a65a8da90fd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:23.570148 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-50da2441-423c-4f84-b74b-0a65a8da90fd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:23.570912 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-50da2441-423c-4f84-b74b-0a65a8da90fd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:23.571366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-50da2441-423c-4f84-b74b-0a65a8da90fd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:23.571788 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-50da2441-423c-4f84-b74b-0a65a8da90fd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:23.773540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-4bccc2d0-c818-45fd-b7d9-994b0540c262 req-39f448ec-6ce2-47e5-bc61-f44d0c7b2287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d888aa-c703-4e3b-b9a7-9fdeb9416957", "name": "network-vif-deleted", "tag": "5ee4f602-378b-4a47-938f-9e415882fde4"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:23.783282 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-4bccc2d0-c818-45fd-b7d9-994b0540c262 req-39f448ec-6ce2-47e5-bc61-f44d0c7b2287 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:23.783767 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-4bccc2d0-c818-45fd-b7d9-994b0540c262 req-39f448ec-6ce2-47e5-bc61-f44d0c7b2287 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:23.784202 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-4bccc2d0-c818-45fd-b7d9-994b0540c262 req-39f448ec-6ce2-47e5-bc61-f44d0c7b2287 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:23.786154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-50da2441-423c-4f84-b74b-0a65a8da90fd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:23.794340 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-50da2441-423c-4f84-b74b-0a65a8da90fd tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1512 microversion: 2.1 time: 0.236836 Aug 10 23:30:23.794936 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 565/1125] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:23 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:23.796017 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-4bccc2d0-c818-45fd-b7d9-994b0540c262 req-39f448ec-6ce2-47e5-bc61-f44d0c7b2287 service nova] Creating event network-vif-deleted:5ee4f602-378b-4a47-938f-9e415882fde4 for instance b5d888aa-c703-4e3b-b9a7-9fdeb9416957 on hv-cinder-85144 Aug 10 23:30:23.801744 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-4bccc2d0-c818-45fd-b7d9-994b0540c262 req-39f448ec-6ce2-47e5-bc61-f44d0c7b2287 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031554 Aug 10 23:30:23.802334 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 561/1126] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:24.815340 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:24.815918 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:24.822313 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:24.822850 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:24.823991 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:24.824563 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:24.825023 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:24.825538 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:24.855838 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:24.856329 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:24.856771 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:24.857261 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lazy-loading 'fault' on Instance uuid b5d888aa-c703-4e3b-b9a7-9fdeb9416957 {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:30:24.899576 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:24.906419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c9d38157-3536-425c-ada9-a6df0af88de7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 200 len: 1308 microversion: 2.1 time: 0.095036 Aug 10 23:30:24.909970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 566/1127] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:24 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:25.928538 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:25.929232 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: b5d888aa-c703-4e3b-b9a7-9fdeb9416957] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:25.935778 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:25.936256 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:25.936692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:25.937379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:25.937836 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:25.938406 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:25.951905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] HTTP exception thrown: Instance b5d888aa-c703-4e3b-b9a7-9fdeb9416957 could not be found. Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Request method failure captured: Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 HTTP/1.1 Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D9FoFBBguMFKvSZY_EebzdhDo4Kjs9nTn7CWuWQgPHOn_uN-9tnG0n8BJ2Dpgh1VPEE6Umd_re5-THjqKBeeh9sFRDSBmAzL0vgxVrSLl60iMRlrALY2kdx-qSs0M-PRKE9DqVJUpJVQb77QP9M8ndRo5TIX0t-D5Llbd1sd3VhXGU Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 76c66a7fe733409a88b4584a7e10bb4f Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1384250767 Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:30:25.953476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76c66a7fe733409a88b4584a7e10bb4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76c66a7fe733409a88b4584a7e10bb4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/76c66a7fe733409a88b4584a7e10bb4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_76c66a7fe733409a88b4584a7e10bb4f", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-VolumesSnapshotTestJSON-1384250767 Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 76c66a7fe733409a88b4584a7e10bb4f Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1384250767 Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-VolumesSnapshotTestJSON-1384250767-project Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 892815f6b41f4ec3acb52275ace9a172 Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-VolumesSnapshotTestJSON-1384250767-project Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance b5d888aa-c703-4e3b-b9a7-9fdeb9416957 could not be found. Aug 10 23:30:25.955379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'b5d888aa-c703-4e3b-b9a7-9fdeb9416957'} Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d888aa-c703-4e3b-b9a7-9fdeb9416957 could not be found. Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:30:25.956408 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d888aa-c703-4e3b-b9a7-9fdeb9416957 could not be found. Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d888aa-c703-4e3b-b9a7-9fdeb9416957 could not be found. Aug 10 23:30:25.957908 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:30:25.959276 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Returning 404 to user: Instance b5d888aa-c703-4e3b-b9a7-9fdeb9416957 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:30:25.959276 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-8b5e7f30-bbfb-480b-84ef-83c496450e7d tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957" status: 404 len: 111 microversion: 2.1 time: 0.030671 Aug 10 23:30:25.959276 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 562/1128] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:25 2022] GET /compute/v2.1/servers/b5d888aa-c703-4e3b-b9a7-9fdeb9416957 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:30:36.598172 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1991350793", "imageRef": "1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7", "flavorRef": "452", "networks": [{"uuid": "1cd08d29-3270-4ca5-ae77-90228d96ab73"}]}} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:36.606689 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=10 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:36.607351 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:36.651272 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.network.neutron [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] validate_networks() for [('1cd08d29-3270-4ca5-ae77-90228d96ab73', None, None, None, None, None)] {{(pid=121332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:30:37.110144 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Flavor limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:30:37.110554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Image limits 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:30:37.111061 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Flavor pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:30:37.111468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Image pref 0:0:0 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:30:37.111976 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.virt.hardware [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:30:37.120661 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:37.121136 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:37.121567 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:37.122322 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:37.122832 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:37.123851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:37.140618 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Getting quotas for project 76c66a7fe733409a88b4584a7e10bb4f. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:30:37.146167 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.quota [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Getting quotas for user 892815f6b41f4ec3acb52275ace9a172 and project 76c66a7fe733409a88b4584a7e10bb4f. Resources: {'instances', 'cores', 'ram'} {{(pid=121332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:30:37.155310 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Going to run 1 instances... {{(pid=121332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:30:37.157571 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ce0dd6f-842b-4bdc-be1d-f86dbe1854f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:30:37.276717 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2a0c78ae-7e92-4418-b42c-22eb203988bb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682382 Aug 10 23:30:37.277366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 567/1129] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:30:37.288214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-5b754f0a-424f-4104-990d-a6f68e5c00d5 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:37.288835 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-5b754f0a-424f-4104-990d-a6f68e5c00d5 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:37.291165 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:37.291829 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:37.348680 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-5b754f0a-424f-4104-990d-a6f68e5c00d5 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:37.355419 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-5b754f0a-424f-4104-990d-a6f68e5c00d5 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1219 microversion: 2.1 time: 0.070928 Aug 10 23:30:37.355990 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 563/1130] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:37 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:38.376933 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-59d51743-6114-4542-8617-87cc1e9c8c0e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:38.377558 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-59d51743-6114-4542-8617-87cc1e9c8c0e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:38.384573 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-59d51743-6114-4542-8617-87cc1e9c8c0e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:38.385083 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-59d51743-6114-4542-8617-87cc1e9c8c0e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:38.385517 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-59d51743-6114-4542-8617-87cc1e9c8c0e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:38.386202 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-59d51743-6114-4542-8617-87cc1e9c8c0e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:38.386680 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-59d51743-6114-4542-8617-87cc1e9c8c0e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:38.387130 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-59d51743-6114-4542-8617-87cc1e9c8c0e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:38.451132 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-59d51743-6114-4542-8617-87cc1e9c8c0e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:38.458733 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-59d51743-6114-4542-8617-87cc1e9c8c0e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1223 microversion: 2.1 time: 0.086252 Aug 10 23:30:38.459286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 568/1131] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:38 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:39.480582 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-29c96795-46bf-451b-b9f9-0f8e51b66016 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:39.481193 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-29c96795-46bf-451b-b9f9-0f8e51b66016 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:39.492428 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-29c96795-46bf-451b-b9f9-0f8e51b66016 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:39.492917 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-29c96795-46bf-451b-b9f9-0f8e51b66016 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:39.493351 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-29c96795-46bf-451b-b9f9-0f8e51b66016 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:39.494636 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-29c96795-46bf-451b-b9f9-0f8e51b66016 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:39.494636 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-29c96795-46bf-451b-b9f9-0f8e51b66016 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:39.494938 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-29c96795-46bf-451b-b9f9-0f8e51b66016 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:39.589110 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-29c96795-46bf-451b-b9f9-0f8e51b66016 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:39.597573 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-29c96795-46bf-451b-b9f9-0f8e51b66016 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1279 microversion: 2.1 time: 0.121491 Aug 10 23:30:39.598245 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 564/1132] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:39 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:40.619011 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a408b48a-5d98-4af0-886c-1979c969613e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:40.619643 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a408b48a-5d98-4af0-886c-1979c969613e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:40.626560 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a408b48a-5d98-4af0-886c-1979c969613e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:40.627056 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a408b48a-5d98-4af0-886c-1979c969613e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:40.627496 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a408b48a-5d98-4af0-886c-1979c969613e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:40.628199 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a408b48a-5d98-4af0-886c-1979c969613e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:40.628653 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a408b48a-5d98-4af0-886c-1979c969613e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:40.629095 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a408b48a-5d98-4af0-886c-1979c969613e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:40.840235 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a408b48a-5d98-4af0-886c-1979c969613e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:40.847728 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a408b48a-5d98-4af0-886c-1979c969613e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1319 microversion: 2.1 time: 0.232705 Aug 10 23:30:40.848289 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 569/1133] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:40 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:41.269724 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-deb9dd6f-e5c3-44eb-9b6b-8a246680b01d req-35b3fc34-a52a-4f2d-aede-20ded357ded5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a15404c-412c-499e-832a-8acbaf9860ee", "tag": "aaf06ae5-d3bb-4e4f-9fbb-6998e01842f6"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:41.280719 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-deb9dd6f-e5c3-44eb-9b6b-8a246680b01d req-35b3fc34-a52a-4f2d-aede-20ded357ded5 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:41.281195 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-deb9dd6f-e5c3-44eb-9b6b-8a246680b01d req-35b3fc34-a52a-4f2d-aede-20ded357ded5 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:41.281624 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-deb9dd6f-e5c3-44eb-9b6b-8a246680b01d req-35b3fc34-a52a-4f2d-aede-20ded357ded5 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:41.292568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-deb9dd6f-e5c3-44eb-9b6b-8a246680b01d req-35b3fc34-a52a-4f2d-aede-20ded357ded5 service nova] Creating event network-changed:aaf06ae5-d3bb-4e4f-9fbb-6998e01842f6 for instance 5a15404c-412c-499e-832a-8acbaf9860ee on hv-cinder-85144 Aug 10 23:30:41.298283 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-deb9dd6f-e5c3-44eb-9b6b-8a246680b01d req-35b3fc34-a52a-4f2d-aede-20ded357ded5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032269 Aug 10 23:30:41.299238 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 565/1134] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:30:41.872747 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-8b12baf8-94b8-4cc2-97e9-9ceff58b3e78 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:41.873909 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-8b12baf8-94b8-4cc2-97e9-9ceff58b3e78 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:41.880308 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b12baf8-94b8-4cc2-97e9-9ceff58b3e78 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:41.880786 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b12baf8-94b8-4cc2-97e9-9ceff58b3e78 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:41.881216 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b12baf8-94b8-4cc2-97e9-9ceff58b3e78 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:41.881913 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b12baf8-94b8-4cc2-97e9-9ceff58b3e78 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:41.882365 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b12baf8-94b8-4cc2-97e9-9ceff58b3e78 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:41.882814 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-8b12baf8-94b8-4cc2-97e9-9ceff58b3e78 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:42.042964 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-8b12baf8-94b8-4cc2-97e9-9ceff58b3e78 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:42.050335 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-8b12baf8-94b8-4cc2-97e9-9ceff58b3e78 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1319 microversion: 2.1 time: 0.181546 Aug 10 23:30:42.051079 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 570/1135] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:41 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:43.072374 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9d0aa411-265d-455f-a4ed-f0d2bdb76128 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:43.073060 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9d0aa411-265d-455f-a4ed-f0d2bdb76128 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:43.080021 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d0aa411-265d-455f-a4ed-f0d2bdb76128 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:43.080498 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d0aa411-265d-455f-a4ed-f0d2bdb76128 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:43.080927 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d0aa411-265d-455f-a4ed-f0d2bdb76128 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:43.081618 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d0aa411-265d-455f-a4ed-f0d2bdb76128 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:43.082071 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d0aa411-265d-455f-a4ed-f0d2bdb76128 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:43.082489 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9d0aa411-265d-455f-a4ed-f0d2bdb76128 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:43.214054 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9d0aa411-265d-455f-a4ed-f0d2bdb76128 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:43.222379 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9d0aa411-265d-455f-a4ed-f0d2bdb76128 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1319 microversion: 2.1 time: 0.154773 Aug 10 23:30:43.222961 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 566/1136] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:43 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:44.243103 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-ef8a5573-f067-4482-8467-e77dba1acfb0 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:44.243787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-ef8a5573-f067-4482-8467-e77dba1acfb0 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:44.250497 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef8a5573-f067-4482-8467-e77dba1acfb0 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:44.251018 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef8a5573-f067-4482-8467-e77dba1acfb0 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:44.251465 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef8a5573-f067-4482-8467-e77dba1acfb0 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:44.252169 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef8a5573-f067-4482-8467-e77dba1acfb0 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:44.252623 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef8a5573-f067-4482-8467-e77dba1acfb0 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:44.253051 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-ef8a5573-f067-4482-8467-e77dba1acfb0 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:44.381708 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-ef8a5573-f067-4482-8467-e77dba1acfb0 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:44.389262 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-ef8a5573-f067-4482-8467-e77dba1acfb0 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1319 microversion: 2.1 time: 0.149980 Aug 10 23:30:44.389825 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 571/1137] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:44 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:45.409728 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-b8e089d7-cf14-4553-a035-c3cbdb4cf2cc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:45.410345 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-b8e089d7-cf14-4553-a035-c3cbdb4cf2cc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:45.416809 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8e089d7-cf14-4553-a035-c3cbdb4cf2cc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:45.417297 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8e089d7-cf14-4553-a035-c3cbdb4cf2cc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:45.417736 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8e089d7-cf14-4553-a035-c3cbdb4cf2cc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:45.418435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8e089d7-cf14-4553-a035-c3cbdb4cf2cc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:45.418925 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8e089d7-cf14-4553-a035-c3cbdb4cf2cc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:45.419362 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-b8e089d7-cf14-4553-a035-c3cbdb4cf2cc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:45.550151 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-b8e089d7-cf14-4553-a035-c3cbdb4cf2cc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:45.557664 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-b8e089d7-cf14-4553-a035-c3cbdb4cf2cc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1319 microversion: 2.1 time: 0.151761 Aug 10 23:30:45.558237 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 567/1138] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:45 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:46.579716 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e748376a-5155-42b3-b132-0d43e9a85d11 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:46.580275 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e748376a-5155-42b3-b132-0d43e9a85d11 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:46.586650 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e748376a-5155-42b3-b132-0d43e9a85d11 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:46.587156 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e748376a-5155-42b3-b132-0d43e9a85d11 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:46.587595 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e748376a-5155-42b3-b132-0d43e9a85d11 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:46.588298 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e748376a-5155-42b3-b132-0d43e9a85d11 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:46.588756 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e748376a-5155-42b3-b132-0d43e9a85d11 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:46.589185 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e748376a-5155-42b3-b132-0d43e9a85d11 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:46.714494 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e748376a-5155-42b3-b132-0d43e9a85d11 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:46.721921 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e748376a-5155-42b3-b132-0d43e9a85d11 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1319 microversion: 2.1 time: 0.147126 Aug 10 23:30:46.722499 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 572/1139] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:46 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:47.745613 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-46af0bb0-c901-4969-9fa5-bb1ef2c4a748 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:47.746567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-46af0bb0-c901-4969-9fa5-bb1ef2c4a748 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:47.748883 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:47.753955 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-46af0bb0-c901-4969-9fa5-bb1ef2c4a748 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:47.754448 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-46af0bb0-c901-4969-9fa5-bb1ef2c4a748 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:47.754918 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-46af0bb0-c901-4969-9fa5-bb1ef2c4a748 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:47.755632 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-46af0bb0-c901-4969-9fa5-bb1ef2c4a748 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:47.756152 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-46af0bb0-c901-4969-9fa5-bb1ef2c4a748 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:47.756586 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-46af0bb0-c901-4969-9fa5-bb1ef2c4a748 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:47.894398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-46af0bb0-c901-4969-9fa5-bb1ef2c4a748 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:47.903716 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-46af0bb0-c901-4969-9fa5-bb1ef2c4a748 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1319 microversion: 2.1 time: 0.162912 Aug 10 23:30:47.904436 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 568/1140] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:47 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:48.004560 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:48.008498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=6 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:48.128260 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-b50cfd5f-1ebc-4519-9320-6669283376a8 req-93bf42f8-ef98-4bfc-8319-14d303b1e39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a15404c-412c-499e-832a-8acbaf9860ee", "name": "network-vif-plugged", "status": "completed", "tag": "aaf06ae5-d3bb-4e4f-9fbb-6998e01842f6"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:48.137601 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-b50cfd5f-1ebc-4519-9320-6669283376a8 req-93bf42f8-ef98-4bfc-8319-14d303b1e39e service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:48.138076 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-b50cfd5f-1ebc-4519-9320-6669283376a8 req-93bf42f8-ef98-4bfc-8319-14d303b1e39e service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:48.138507 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-b50cfd5f-1ebc-4519-9320-6669283376a8 req-93bf42f8-ef98-4bfc-8319-14d303b1e39e service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:48.149367 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-b50cfd5f-1ebc-4519-9320-6669283376a8 req-93bf42f8-ef98-4bfc-8319-14d303b1e39e service nova] Creating event network-vif-plugged:aaf06ae5-d3bb-4e4f-9fbb-6998e01842f6 for instance 5a15404c-412c-499e-832a-8acbaf9860ee on hv-cinder-85144 Aug 10 23:30:48.154370 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-b50cfd5f-1ebc-4519-9320-6669283376a8 req-93bf42f8-ef98-4bfc-8319-14d303b1e39e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154407 Aug 10 23:30:48.155001 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 573/1141] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:30:48.923623 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-1f826ebd-b790-4ea0-ad9b-79847c3c8dd1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:48.924221 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-1f826ebd-b790-4ea0-ad9b-79847c3c8dd1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:48.930682 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1f826ebd-b790-4ea0-ad9b-79847c3c8dd1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:48.931184 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1f826ebd-b790-4ea0-ad9b-79847c3c8dd1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:48.931617 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1f826ebd-b790-4ea0-ad9b-79847c3c8dd1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:48.932335 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1f826ebd-b790-4ea0-ad9b-79847c3c8dd1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:48.932786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1f826ebd-b790-4ea0-ad9b-79847c3c8dd1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:48.933204 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-1f826ebd-b790-4ea0-ad9b-79847c3c8dd1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:49.062088 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-1f826ebd-b790-4ea0-ad9b-79847c3c8dd1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:49.070187 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-1f826ebd-b790-4ea0-ad9b-79847c3c8dd1 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1319 microversion: 2.1 time: 0.150576 Aug 10 23:30:49.070775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 569/1142] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:48 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:50.092233 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-c23e0525-f6a6-4885-a2dd-8a8ad642d16c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:50.092858 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-c23e0525-f6a6-4885-a2dd-8a8ad642d16c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:50.100865 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c23e0525-f6a6-4885-a2dd-8a8ad642d16c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:50.101411 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c23e0525-f6a6-4885-a2dd-8a8ad642d16c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:50.101852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c23e0525-f6a6-4885-a2dd-8a8ad642d16c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:50.102560 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c23e0525-f6a6-4885-a2dd-8a8ad642d16c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:50.104231 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c23e0525-f6a6-4885-a2dd-8a8ad642d16c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:50.107168 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-c23e0525-f6a6-4885-a2dd-8a8ad642d16c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:50.247035 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-c23e0525-f6a6-4885-a2dd-8a8ad642d16c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:50.258877 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-c23e0525-f6a6-4885-a2dd-8a8ad642d16c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1507 microversion: 2.1 time: 0.171871 Aug 10 23:30:50.259669 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 574/1143] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:50 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:50.280200 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dfc21449-86df-4295-a66a-c08ead4d0d6e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "758a6e80-2984-4ba3-9c97-c80ef0c316ae", "device": "/dev/sdb"}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:50.282601 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dfc21449-86df-4295-a66a-c08ead4d0d6e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:50.290329 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dfc21449-86df-4295-a66a-c08ead4d0d6e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:50.301522 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dfc21449-86df-4295-a66a-c08ead4d0d6e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:50.301522 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dfc21449-86df-4295-a66a-c08ead4d0d6e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:50.301522 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dfc21449-86df-4295-a66a-c08ead4d0d6e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:50.301522 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dfc21449-86df-4295-a66a-c08ead4d0d6e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:50.301935 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dfc21449-86df-4295-a66a-c08ead4d0d6e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:51.536140 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dfc21449-86df-4295-a66a-c08ead4d0d6e tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "POST /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.259620 Aug 10 23:30:51.536949 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 570/1144] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 10 23:30:50 2022] POST /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee/os-volume_attachments => generated 194 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:31:20.055854 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-5eab11f6-d63e-4ee4-aea1-77cda35eedcb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:20.056366 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-5eab11f6-d63e-4ee4-aea1-77cda35eedcb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:20.058401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:20.059180 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=40 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:20.063921 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5eab11f6-d63e-4ee4-aea1-77cda35eedcb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:20.064401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5eab11f6-d63e-4ee4-aea1-77cda35eedcb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:20.064847 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5eab11f6-d63e-4ee4-aea1-77cda35eedcb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:20.065542 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5eab11f6-d63e-4ee4-aea1-77cda35eedcb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:20.066113 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5eab11f6-d63e-4ee4-aea1-77cda35eedcb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:20.066546 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-5eab11f6-d63e-4ee4-aea1-77cda35eedcb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:20.154938 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-5eab11f6-d63e-4ee4-aea1-77cda35eedcb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lazy-loading 'services' on Instance uuid 5a15404c-412c-499e-832a-8acbaf9860ee {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:31:20.394674 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-5eab11f6-d63e-4ee4-aea1-77cda35eedcb tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee/os-volume_attachments/758a6e80-2984-4ba3-9c97-c80ef0c316ae" status: 202 len: 0 microversion: 2.1 time: 0.342839 Aug 10 23:31:20.395282 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 575/1145] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 10 23:31:20 2022] DELETE /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee/os-volume_attachments/758a6e80-2984-4ba3-9c97-c80ef0c316ae => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:31:24.691000 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=18 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:24.691807 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:24.696132 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-4d08dc54-5b48-497a-8228-35b6a840a186 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:24.696726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4d08dc54-5b48-497a-8228-35b6a840a186 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:24.703765 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d08dc54-5b48-497a-8228-35b6a840a186 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:24.704259 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d08dc54-5b48-497a-8228-35b6a840a186 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:24.709786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d08dc54-5b48-497a-8228-35b6a840a186 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:24.709786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d08dc54-5b48-497a-8228-35b6a840a186 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:24.709786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d08dc54-5b48-497a-8228-35b6a840a186 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:24.709786 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-4d08dc54-5b48-497a-8228-35b6a840a186 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:24.732020 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-4d08dc54-5b48-497a-8228-35b6a840a186 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Going to try to terminate instance {{(pid=121333) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:31:25.148857 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-4d08dc54-5b48-497a-8228-35b6a840a186 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 204 len: 0 microversion: 2.1 time: 0.458767 Aug 10 23:31:25.149461 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 571/1146] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:31:24 2022] DELETE /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:31:25.159294 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-7461472e-7f81-44a2-8624-a6d57000d7b7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:25.160002 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-7461472e-7f81-44a2-8624-a6d57000d7b7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:25.166393 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7461472e-7f81-44a2-8624-a6d57000d7b7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:25.166904 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7461472e-7f81-44a2-8624-a6d57000d7b7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:25.167344 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7461472e-7f81-44a2-8624-a6d57000d7b7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:25.168037 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7461472e-7f81-44a2-8624-a6d57000d7b7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:25.168489 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7461472e-7f81-44a2-8624-a6d57000d7b7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:25.169422 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-7461472e-7f81-44a2-8624-a6d57000d7b7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:25.299277 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-7461472e-7f81-44a2-8624-a6d57000d7b7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:25.306766 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-7461472e-7f81-44a2-8624-a6d57000d7b7 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1513 microversion: 2.1 time: 0.152330 Aug 10 23:31:25.307334 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 576/1147] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:25 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:31:25.706000 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1592917163", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1887301686", "security_groups": [{"name": "tempest-secgroup-smoke-2115761121"}], "block_device_mapping_v2": [{"uuid": "ef4c65ba-531a-4c68-b2a4-2fa1b7cdce45", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "261d6c55-7a8c-4ed0-b668-a538a8c25216"}]}} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:25.818188 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.network.neutron [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] validate_networks() for [('261d6c55-7a8c-4ed0-b668-a538a8c25216', None, None, None, None, None)] {{(pid=121333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:31:26.222781 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Flavor limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:31:26.223214 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Image limits 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:31:26.223689 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Flavor pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:31:26.224100 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Image pref 0:0:0 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:31:26.224513 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.virt.hardware [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:31:26.233208 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:26.233686 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:26.234125 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:26.234899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:26.235371 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:26.235799 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:26.253143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Getting quotas for project 8d2bfa865669477f8757e977da29420a. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:31:26.257071 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.quota [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Getting quotas for user 05e18a4fd73e435aa6d0f10a37405698 and project 8d2bfa865669477f8757e977da29420a. Resources: {'instances', 'cores', 'ram'} {{(pid=121333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:31:26.314222 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Going to run 1 instances... {{(pid=121333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:31:26.316471 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef4c65ba-531a-4c68-b2a4-2fa1b7cdce45',volume_size=None,volume_type=None)] {{(pid=121333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:31:26.328322 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-b0933037-3b2e-494d-89f0-be3346b024b4 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:26.328945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-b0933037-3b2e-494d-89f0-be3346b024b4 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:26.336256 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0933037-3b2e-494d-89f0-be3346b024b4 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:26.336744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0933037-3b2e-494d-89f0-be3346b024b4 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:26.337185 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0933037-3b2e-494d-89f0-be3346b024b4 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:26.337891 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0933037-3b2e-494d-89f0-be3346b024b4 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:26.338348 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0933037-3b2e-494d-89f0-be3346b024b4 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:26.338802 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-b0933037-3b2e-494d-89f0-be3346b024b4 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:26.471607 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-b0933037-3b2e-494d-89f0-be3346b024b4 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:26.479170 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-b0933037-3b2e-494d-89f0-be3346b024b4 tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1513 microversion: 2.1 time: 0.155056 Aug 10 23:31:26.479744 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 577/1148] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:26 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:31:26.767212 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-dddfa549-4acc-4bd8-acd0-23d1a07c05b8 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.065376 Aug 10 23:31:26.773091 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 572/1149] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 10 23:31:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:31:26.778601 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-56e8e1eb-cc31-470a-a49b-a644c90a8734 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:26.779250 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-56e8e1eb-cc31-470a-a49b-a644c90a8734 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:26.832036 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-56e8e1eb-cc31-470a-a49b-a644c90a8734 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:26.840007 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-56e8e1eb-cc31-470a-a49b-a644c90a8734 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1095 microversion: 2.1 time: 0.065141 Aug 10 23:31:26.840713 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 578/1150] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:26 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:31:27.500851 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2a34faf3-6033-478f-b64c-c88f187cba0c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:27.501517 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2a34faf3-6033-478f-b64c-c88f187cba0c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:27.508642 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a34faf3-6033-478f-b64c-c88f187cba0c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:27.509136 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a34faf3-6033-478f-b64c-c88f187cba0c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:27.509570 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a34faf3-6033-478f-b64c-c88f187cba0c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:27.510604 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a34faf3-6033-478f-b64c-c88f187cba0c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:27.511296 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a34faf3-6033-478f-b64c-c88f187cba0c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:27.511725 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2a34faf3-6033-478f-b64c-c88f187cba0c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:27.784046 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2a34faf3-6033-478f-b64c-c88f187cba0c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:27.793412 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2a34faf3-6033-478f-b64c-c88f187cba0c tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1513 microversion: 2.1 time: 0.296499 Aug 10 23:31:27.794568 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 573/1151] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:27 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:27.862760 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-a3fc2ed6-65eb-44a7-a3f2-ed1af5445726 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:27.863566 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-a3fc2ed6-65eb-44a7-a3f2-ed1af5445726 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:27.873217 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3fc2ed6-65eb-44a7-a3f2-ed1af5445726 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:27.873710 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3fc2ed6-65eb-44a7-a3f2-ed1af5445726 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:27.874147 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3fc2ed6-65eb-44a7-a3f2-ed1af5445726 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:27.874892 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3fc2ed6-65eb-44a7-a3f2-ed1af5445726 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:27.875348 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3fc2ed6-65eb-44a7-a3f2-ed1af5445726 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:27.875774 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-a3fc2ed6-65eb-44a7-a3f2-ed1af5445726 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:27.949628 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-a3fc2ed6-65eb-44a7-a3f2-ed1af5445726 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:27.957549 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-a3fc2ed6-65eb-44a7-a3f2-ed1af5445726 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1145 microversion: 2.1 time: 0.099829 Aug 10 23:31:27.958394 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 579/1152] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:27 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1145 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:28.173192 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-da217657-e025-4245-8c25-de0711dae2e2 req-f1842d14-3e94-462e-a6e0-7c984b55f379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a15404c-412c-499e-832a-8acbaf9860ee", "name": "network-vif-deleted", "tag": "aaf06ae5-d3bb-4e4f-9fbb-6998e01842f6"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:28.182871 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-da217657-e025-4245-8c25-de0711dae2e2 req-f1842d14-3e94-462e-a6e0-7c984b55f379 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:28.183342 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-da217657-e025-4245-8c25-de0711dae2e2 req-f1842d14-3e94-462e-a6e0-7c984b55f379 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:28.183766 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-da217657-e025-4245-8c25-de0711dae2e2 req-f1842d14-3e94-462e-a6e0-7c984b55f379 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:28.196977 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-da217657-e025-4245-8c25-de0711dae2e2 req-f1842d14-3e94-462e-a6e0-7c984b55f379 service nova] Creating event network-vif-deleted:aaf06ae5-d3bb-4e4f-9fbb-6998e01842f6 for instance 5a15404c-412c-499e-832a-8acbaf9860ee on hv-cinder-85144 Aug 10 23:31:28.202460 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-da217657-e025-4245-8c25-de0711dae2e2 req-f1842d14-3e94-462e-a6e0-7c984b55f379 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033103 Aug 10 23:31:28.203419 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 574/1153] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:31:28.815886 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:28.816509 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:28.822462 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:28.822984 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:28.823432 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:28.827223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:28.827223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:28.827223 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:28.855056 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:28.855533 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:28.855975 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:28.856925 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.objects.instance [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lazy-loading 'fault' on Instance uuid 5a15404c-412c-499e-832a-8acbaf9860ee {{(pid=121332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:31:28.897282 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892815f6b41f4ec3acb52275ace9a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c66a7fe733409a88b4584a7e10bb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:28.904880 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cd1d208e-00a2-42e4-9a1d-029742d49dbc tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 200 len: 1309 microversion: 2.1 time: 0.092901 Aug 10 23:31:28.905449 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 580/1154] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:28 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:28.979619 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-86f335de-931e-4077-a728-baa23d77f0e4 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:28.980318 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-86f335de-931e-4077-a728-baa23d77f0e4 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:28.989380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-86f335de-931e-4077-a728-baa23d77f0e4 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:28.989380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-86f335de-931e-4077-a728-baa23d77f0e4 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:28.989380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-86f335de-931e-4077-a728-baa23d77f0e4 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:28.989380 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-86f335de-931e-4077-a728-baa23d77f0e4 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:28.989849 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-86f335de-931e-4077-a728-baa23d77f0e4 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:28.990244 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-86f335de-931e-4077-a728-baa23d77f0e4 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:29.066548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-86f335de-931e-4077-a728-baa23d77f0e4 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:29.071586 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-86f335de-931e-4077-a728-baa23d77f0e4 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1211 microversion: 2.1 time: 0.096347 Aug 10 23:31:29.074556 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 575/1155] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:28 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:29.926030 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:29.926821 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] [instance: 5a15404c-412c-499e-832a-8acbaf9860ee] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:29.933327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:29.933815 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:29.934348 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:29.935163 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:29.935693 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:29.936209 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:29.950292 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] HTTP exception thrown: Instance 5a15404c-412c-499e-832a-8acbaf9860ee could not be found. Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Request method failure captured: Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee HTTP/1.1 Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D9FoFBBguMFKvSZY_EebzdhDo4Kjs9nTn7CWuWQgPHOn_uN-9tnG0n8BJ2Dpgh1VPEE6Umd_re5-THjqKBeeh9sFRDSBmAzL0vgxVrSLl60iMRlrALY2kdx-qSs0M-PRKE9DqVJUpJVQb77QP9M8ndRo5TIX0t-D5Llbd1sd3VhXGU Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 76c66a7fe733409a88b4584a7e10bb4f Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1384250767 Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:31:29.952050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76c66a7fe733409a88b4584a7e10bb4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76c66a7fe733409a88b4584a7e10bb4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/76c66a7fe733409a88b4584a7e10bb4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_76c66a7fe733409a88b4584a7e10bb4f", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-VolumesSnapshotTestJSON-1384250767 Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 76c66a7fe733409a88b4584a7e10bb4f Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1384250767 Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-VolumesSnapshotTestJSON-1384250767-project Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 892815f6b41f4ec3acb52275ace9a172 Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-VolumesSnapshotTestJSON-1384250767-project Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance 5a15404c-412c-499e-832a-8acbaf9860ee could not be found. Aug 10 23:31:29.953870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': '5a15404c-412c-499e-832a-8acbaf9860ee'} Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a15404c-412c-499e-832a-8acbaf9860ee could not be found. Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:31:29.955046 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a15404c-412c-499e-832a-8acbaf9860ee could not be found. Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a15404c-412c-499e-832a-8acbaf9860ee could not be found. Aug 10 23:31:29.957196 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:31:29.958498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] Returning 404 to user: Instance 5a15404c-412c-499e-832a-8acbaf9860ee could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:31:29.958498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-cb7aa4b6-8866-44d2-bc56-a09f765caf2f tempest-VolumesSnapshotTestJSON-1384250767 tempest-VolumesSnapshotTestJSON-1384250767-project] 10.222.0.78 "GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee" status: 404 len: 111 microversion: 2.1 time: 0.031385 Aug 10 23:31:29.958498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 581/1156] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:29 2022] GET /compute/v2.1/servers/5a15404c-412c-499e-832a-8acbaf9860ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:31:30.093673 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-bf57662d-bd51-4117-8e76-306cdc82bfb0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:30.094301 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-bf57662d-bd51-4117-8e76-306cdc82bfb0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:30.104815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bf57662d-bd51-4117-8e76-306cdc82bfb0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:30.104815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bf57662d-bd51-4117-8e76-306cdc82bfb0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:30.104815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bf57662d-bd51-4117-8e76-306cdc82bfb0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:30.104815 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bf57662d-bd51-4117-8e76-306cdc82bfb0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:30.105255 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bf57662d-bd51-4117-8e76-306cdc82bfb0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:30.105344 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-bf57662d-bd51-4117-8e76-306cdc82bfb0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:30.354375 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-bf57662d-bd51-4117-8e76-306cdc82bfb0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:30.362838 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-bf57662d-bd51-4117-8e76-306cdc82bfb0 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1279 microversion: 2.1 time: 0.273657 Aug 10 23:31:30.363518 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 576/1157] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:30 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1279 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:30.605221 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-829ba035-ed44-4113-be32-398152ff3abc req-74558e0d-0392-488a-827c-13804e61a1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d80ed5-d087-4f53-9d42-549d563abe1e", "tag": "96692853-a89b-49d6-b42c-c2c7b9096980"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:30.615416 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-829ba035-ed44-4113-be32-398152ff3abc req-74558e0d-0392-488a-827c-13804e61a1b5 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:30.615894 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-829ba035-ed44-4113-be32-398152ff3abc req-74558e0d-0392-488a-827c-13804e61a1b5 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:30.616327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-829ba035-ed44-4113-be32-398152ff3abc req-74558e0d-0392-488a-827c-13804e61a1b5 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:30.628389 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-829ba035-ed44-4113-be32-398152ff3abc req-74558e0d-0392-488a-827c-13804e61a1b5 service nova] Creating event network-changed:96692853-a89b-49d6-b42c-c2c7b9096980 for instance 48d80ed5-d087-4f53-9d42-549d563abe1e on hv-cinder-85144 Aug 10 23:31:30.634513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-829ba035-ed44-4113-be32-398152ff3abc req-74558e0d-0392-488a-827c-13804e61a1b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031952 Aug 10 23:31:30.634513 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 582/1158] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:31:31.383548 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-9158b4be-3bc1-461a-9934-749c6b096e80 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:31.384108 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-9158b4be-3bc1-461a-9934-749c6b096e80 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:31.391466 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9158b4be-3bc1-461a-9934-749c6b096e80 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:31.391981 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9158b4be-3bc1-461a-9934-749c6b096e80 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:31.392418 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9158b4be-3bc1-461a-9934-749c6b096e80 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:31.393124 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9158b4be-3bc1-461a-9934-749c6b096e80 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:31.393605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9158b4be-3bc1-461a-9934-749c6b096e80 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:31.394059 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-9158b4be-3bc1-461a-9934-749c6b096e80 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:31.523396 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-9158b4be-3bc1-461a-9934-749c6b096e80 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:31.530890 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-9158b4be-3bc1-461a-9934-749c6b096e80 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.151253 Aug 10 23:31:31.531460 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 577/1159] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:31 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:32.552370 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-76190883-5867-4373-92f5-ccf202769d45 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:32.553121 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-76190883-5867-4373-92f5-ccf202769d45 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:32.559319 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76190883-5867-4373-92f5-ccf202769d45 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:32.559801 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76190883-5867-4373-92f5-ccf202769d45 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:32.560239 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76190883-5867-4373-92f5-ccf202769d45 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:32.560939 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76190883-5867-4373-92f5-ccf202769d45 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:32.561435 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76190883-5867-4373-92f5-ccf202769d45 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:32.561868 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-76190883-5867-4373-92f5-ccf202769d45 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:32.696692 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-76190883-5867-4373-92f5-ccf202769d45 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:32.704979 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-76190883-5867-4373-92f5-ccf202769d45 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.157444 Aug 10 23:31:32.705545 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 583/1160] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:32 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:33.725913 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-6665d9dd-531f-41c7-afed-efa102e30aba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:33.726501 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-6665d9dd-531f-41c7-afed-efa102e30aba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:33.732916 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6665d9dd-531f-41c7-afed-efa102e30aba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:33.733390 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6665d9dd-531f-41c7-afed-efa102e30aba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:33.733818 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6665d9dd-531f-41c7-afed-efa102e30aba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:33.734504 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6665d9dd-531f-41c7-afed-efa102e30aba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:33.735013 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6665d9dd-531f-41c7-afed-efa102e30aba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:33.735435 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-6665d9dd-531f-41c7-afed-efa102e30aba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:33.862905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-6665d9dd-531f-41c7-afed-efa102e30aba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:33.870311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-6665d9dd-531f-41c7-afed-efa102e30aba tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.148192 Aug 10 23:31:33.870882 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 578/1161] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:33 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:34.891130 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-79401c25-06a0-464c-b4a9-1fd86f370346 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:34.891774 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-79401c25-06a0-464c-b4a9-1fd86f370346 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:34.897851 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79401c25-06a0-464c-b4a9-1fd86f370346 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:34.898332 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79401c25-06a0-464c-b4a9-1fd86f370346 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:34.898800 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79401c25-06a0-464c-b4a9-1fd86f370346 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:34.899498 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79401c25-06a0-464c-b4a9-1fd86f370346 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:34.899957 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79401c25-06a0-464c-b4a9-1fd86f370346 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:34.900383 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-79401c25-06a0-464c-b4a9-1fd86f370346 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:35.031300 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-79401c25-06a0-464c-b4a9-1fd86f370346 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:35.038791 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-79401c25-06a0-464c-b4a9-1fd86f370346 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.151484 Aug 10 23:31:35.039350 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 584/1162] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:34 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:36.060063 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-03ba8886-18bd-4bfe-a29e-38d4a4d60e0c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:36.060679 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-03ba8886-18bd-4bfe-a29e-38d4a4d60e0c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:36.066911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-03ba8886-18bd-4bfe-a29e-38d4a4d60e0c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:36.067397 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-03ba8886-18bd-4bfe-a29e-38d4a4d60e0c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:36.067855 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-03ba8886-18bd-4bfe-a29e-38d4a4d60e0c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:36.068562 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-03ba8886-18bd-4bfe-a29e-38d4a4d60e0c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:36.069015 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-03ba8886-18bd-4bfe-a29e-38d4a4d60e0c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:36.069441 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-03ba8886-18bd-4bfe-a29e-38d4a4d60e0c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:36.198482 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-03ba8886-18bd-4bfe-a29e-38d4a4d60e0c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:36.206624 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-03ba8886-18bd-4bfe-a29e-38d4a4d60e0c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.150974 Aug 10 23:31:36.207205 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 579/1163] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:36 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:37.229914 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e19b0297-953b-4414-b488-9172efb4ebaa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:37.230735 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e19b0297-953b-4414-b488-9172efb4ebaa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:37.239327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell0:SELECT=2 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:37.239327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19b0297-953b-4414-b488-9172efb4ebaa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:37.239327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19b0297-953b-4414-b488-9172efb4ebaa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:37.239327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19b0297-953b-4414-b488-9172efb4ebaa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:37.239811 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19b0297-953b-4414-b488-9172efb4ebaa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:37.239811 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19b0297-953b-4414-b488-9172efb4ebaa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:37.240218 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e19b0297-953b-4414-b488-9172efb4ebaa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:37.375768 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e19b0297-953b-4414-b488-9172efb4ebaa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:37.383356 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e19b0297-953b-4414-b488-9172efb4ebaa tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.157294 Aug 10 23:31:37.383883 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 585/1164] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:37 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:38.404031 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f06066e9-c6db-4602-a144-f3fdfb1aec30 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:38.404644 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f06066e9-c6db-4602-a144-f3fdfb1aec30 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:38.406595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=2 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:38.407283 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell0:SELECT=6 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:38.412674 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f06066e9-c6db-4602-a144-f3fdfb1aec30 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:38.415605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f06066e9-c6db-4602-a144-f3fdfb1aec30 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:38.415605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f06066e9-c6db-4602-a144-f3fdfb1aec30 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:38.415605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f06066e9-c6db-4602-a144-f3fdfb1aec30 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:38.415605 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f06066e9-c6db-4602-a144-f3fdfb1aec30 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:38.416021 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f06066e9-c6db-4602-a144-f3fdfb1aec30 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:38.550285 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f06066e9-c6db-4602-a144-f3fdfb1aec30 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:38.557738 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f06066e9-c6db-4602-a144-f3fdfb1aec30 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.158147 Aug 10 23:31:38.558364 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 580/1165] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:38 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:39.577808 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-37292bbb-3dba-4327-8758-10d946a83ce6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:39.578427 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-37292bbb-3dba-4327-8758-10d946a83ce6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:39.585019 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37292bbb-3dba-4327-8758-10d946a83ce6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:39.585448 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37292bbb-3dba-4327-8758-10d946a83ce6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:39.585888 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37292bbb-3dba-4327-8758-10d946a83ce6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:39.586592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37292bbb-3dba-4327-8758-10d946a83ce6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:39.587100 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37292bbb-3dba-4327-8758-10d946a83ce6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:39.587519 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-37292bbb-3dba-4327-8758-10d946a83ce6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:39.717711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-37292bbb-3dba-4327-8758-10d946a83ce6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:39.725085 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-37292bbb-3dba-4327-8758-10d946a83ce6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.151480 Aug 10 23:31:39.725647 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 586/1166] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:39 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:40.745469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-c50441a3-b957-483f-b88b-eb55635f083a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:40.746077 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-c50441a3-b957-483f-b88b-eb55635f083a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:40.752470 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c50441a3-b957-483f-b88b-eb55635f083a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:40.753271 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c50441a3-b957-483f-b88b-eb55635f083a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:40.753398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c50441a3-b957-483f-b88b-eb55635f083a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:40.754080 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c50441a3-b957-483f-b88b-eb55635f083a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:40.754542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c50441a3-b957-483f-b88b-eb55635f083a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:40.755013 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-c50441a3-b957-483f-b88b-eb55635f083a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:40.900402 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-c50441a3-b957-483f-b88b-eb55635f083a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:40.908603 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-c50441a3-b957-483f-b88b-eb55635f083a tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.167058 Aug 10 23:31:40.909182 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 581/1167] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:40 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:41.929082 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2379e924-40dc-499e-926c-a81f62e8cc4f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:41.929712 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2379e924-40dc-499e-926c-a81f62e8cc4f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:41.936164 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2379e924-40dc-499e-926c-a81f62e8cc4f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:41.936659 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2379e924-40dc-499e-926c-a81f62e8cc4f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:41.937098 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2379e924-40dc-499e-926c-a81f62e8cc4f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:41.937800 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2379e924-40dc-499e-926c-a81f62e8cc4f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:41.938258 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2379e924-40dc-499e-926c-a81f62e8cc4f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:41.938711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2379e924-40dc-499e-926c-a81f62e8cc4f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:42.072193 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2379e924-40dc-499e-926c-a81f62e8cc4f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:42.080599 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2379e924-40dc-499e-926c-a81f62e8cc4f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.155302 Aug 10 23:31:42.081701 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 587/1168] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:41 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:42.253540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-f8c2174d-b7c0-4df4-8394-d3f5abf7b16d req-a404800a-47cd-4cfa-8f0c-80f9c284a7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d80ed5-d087-4f53-9d42-549d563abe1e", "name": "network-vif-plugged", "status": "completed", "tag": "96692853-a89b-49d6-b42c-c2c7b9096980"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:42.263561 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-f8c2174d-b7c0-4df4-8394-d3f5abf7b16d req-a404800a-47cd-4cfa-8f0c-80f9c284a7a0 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:42.264040 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-f8c2174d-b7c0-4df4-8394-d3f5abf7b16d req-a404800a-47cd-4cfa-8f0c-80f9c284a7a0 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:42.264469 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-f8c2174d-b7c0-4df4-8394-d3f5abf7b16d req-a404800a-47cd-4cfa-8f0c-80f9c284a7a0 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:42.276540 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-f8c2174d-b7c0-4df4-8394-d3f5abf7b16d req-a404800a-47cd-4cfa-8f0c-80f9c284a7a0 service nova] Creating event network-vif-plugged:96692853-a89b-49d6-b42c-c2c7b9096980 for instance 48d80ed5-d087-4f53-9d42-549d563abe1e on hv-cinder-85144 Aug 10 23:31:42.283698 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-f8c2174d-b7c0-4df4-8394-d3f5abf7b16d req-a404800a-47cd-4cfa-8f0c-80f9c284a7a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033904 Aug 10 23:31:42.284300 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 582/1169] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:31:43.101952 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-307036ce-f0a4-48c9-bc02-d6c6b55d811b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:43.102490 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-307036ce-f0a4-48c9-bc02-d6c6b55d811b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:43.109420 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-307036ce-f0a4-48c9-bc02-d6c6b55d811b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:43.109908 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-307036ce-f0a4-48c9-bc02-d6c6b55d811b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:43.110350 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-307036ce-f0a4-48c9-bc02-d6c6b55d811b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:43.111079 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-307036ce-f0a4-48c9-bc02-d6c6b55d811b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:43.111537 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-307036ce-f0a4-48c9-bc02-d6c6b55d811b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:43.111968 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-307036ce-f0a4-48c9-bc02-d6c6b55d811b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:43.242069 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-307036ce-f0a4-48c9-bc02-d6c6b55d811b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:43.250359 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-307036ce-f0a4-48c9-bc02-d6c6b55d811b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.152371 Aug 10 23:31:43.250992 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 588/1170] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:43 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:44.272218 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-3d2ac7ba-1c14-42d4-8fbe-e65536a126b2 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:44.272915 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-3d2ac7ba-1c14-42d4-8fbe-e65536a126b2 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:44.280174 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3d2ac7ba-1c14-42d4-8fbe-e65536a126b2 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:44.280656 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3d2ac7ba-1c14-42d4-8fbe-e65536a126b2 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:44.281090 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3d2ac7ba-1c14-42d4-8fbe-e65536a126b2 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:44.281785 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3d2ac7ba-1c14-42d4-8fbe-e65536a126b2 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:44.282239 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3d2ac7ba-1c14-42d4-8fbe-e65536a126b2 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:44.282686 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-3d2ac7ba-1c14-42d4-8fbe-e65536a126b2 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:44.411899 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-3d2ac7ba-1c14-42d4-8fbe-e65536a126b2 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:44.420143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-3d2ac7ba-1c14-42d4-8fbe-e65536a126b2 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.152118 Aug 10 23:31:44.420720 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 583/1171] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:44 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:45.441210 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-e1923060-8711-4582-95c2-42634685f913 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:45.441859 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-e1923060-8711-4582-95c2-42634685f913 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:45.448358 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e1923060-8711-4582-95c2-42634685f913 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:45.448842 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e1923060-8711-4582-95c2-42634685f913 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:45.449285 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e1923060-8711-4582-95c2-42634685f913 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:45.450239 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e1923060-8711-4582-95c2-42634685f913 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:45.450721 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e1923060-8711-4582-95c2-42634685f913 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:45.451154 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-e1923060-8711-4582-95c2-42634685f913 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:45.584050 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-e1923060-8711-4582-95c2-42634685f913 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:45.594064 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-e1923060-8711-4582-95c2-42634685f913 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.156656 Aug 10 23:31:45.594671 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 589/1172] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:45 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:46.617645 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-57f7c4a3-5857-4da3-be0c-9e1b68cc3543 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:46.618258 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-57f7c4a3-5857-4da3-be0c-9e1b68cc3543 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:46.625872 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-57f7c4a3-5857-4da3-be0c-9e1b68cc3543 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:46.626151 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-57f7c4a3-5857-4da3-be0c-9e1b68cc3543 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:46.626620 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-57f7c4a3-5857-4da3-be0c-9e1b68cc3543 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:46.627257 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-57f7c4a3-5857-4da3-be0c-9e1b68cc3543 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:46.627713 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-57f7c4a3-5857-4da3-be0c-9e1b68cc3543 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:46.628145 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-57f7c4a3-5857-4da3-be0c-9e1b68cc3543 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:46.758856 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-57f7c4a3-5857-4da3-be0c-9e1b68cc3543 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:46.766228 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-57f7c4a3-5857-4da3-be0c-9e1b68cc3543 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.152441 Aug 10 23:31:46.766811 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 584/1173] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:46 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:47.786554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-bb17b71f-b94a-4de3-a662-a3a3ca9502b7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:47.787207 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-bb17b71f-b94a-4de3-a662-a3a3ca9502b7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:47.793608 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bb17b71f-b94a-4de3-a662-a3a3ca9502b7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:47.794091 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bb17b71f-b94a-4de3-a662-a3a3ca9502b7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:47.794522 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bb17b71f-b94a-4de3-a662-a3a3ca9502b7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:47.795249 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bb17b71f-b94a-4de3-a662-a3a3ca9502b7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:47.795702 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bb17b71f-b94a-4de3-a662-a3a3ca9502b7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:47.796303 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-bb17b71f-b94a-4de3-a662-a3a3ca9502b7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:47.930559 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-bb17b71f-b94a-4de3-a662-a3a3ca9502b7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:47.938733 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-bb17b71f-b94a-4de3-a662-a3a3ca9502b7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.155967 Aug 10 23:31:47.939316 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 590/1174] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:47 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:48.961303 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-7f311f39-36ac-4f84-bce8-a97b3b80de29 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:48.961929 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-7f311f39-36ac-4f84-bce8-a97b3b80de29 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:48.968602 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7f311f39-36ac-4f84-bce8-a97b3b80de29 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:48.969088 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7f311f39-36ac-4f84-bce8-a97b3b80de29 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:48.969537 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7f311f39-36ac-4f84-bce8-a97b3b80de29 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:48.970251 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7f311f39-36ac-4f84-bce8-a97b3b80de29 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:48.970740 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7f311f39-36ac-4f84-bce8-a97b3b80de29 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:48.971172 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-7f311f39-36ac-4f84-bce8-a97b3b80de29 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:49.102145 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-7f311f39-36ac-4f84-bce8-a97b3b80de29 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:49.110795 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-7f311f39-36ac-4f84-bce8-a97b3b80de29 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1267 microversion: 2.1 time: 0.153513 Aug 10 23:31:49.111414 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 585/1175] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:48 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:50.131592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-f3b82010-e398-45b6-87bb-38577854eba7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:50.132296 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-f3b82010-e398-45b6-87bb-38577854eba7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:50.139491 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3b82010-e398-45b6-87bb-38577854eba7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:50.140078 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3b82010-e398-45b6-87bb-38577854eba7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:50.140565 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3b82010-e398-45b6-87bb-38577854eba7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:50.141265 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3b82010-e398-45b6-87bb-38577854eba7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:50.141719 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3b82010-e398-45b6-87bb-38577854eba7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:50.142150 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-f3b82010-e398-45b6-87bb-38577854eba7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:50.146198 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:50.274954 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-f3b82010-e398-45b6-87bb-38577854eba7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:50.282901 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-f3b82010-e398-45b6-87bb-38577854eba7 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1455 microversion: 2.1 time: 0.155000 Aug 10 23:31:50.291288 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 591/1176] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:50 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:50.303592 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-da175c7d-40df-42ea-9df8-32408a282d42 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:50.304201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-da175c7d-40df-42ea-9df8-32408a282d42 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:50.311161 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-da175c7d-40df-42ea-9df8-32408a282d42 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:50.311637 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-da175c7d-40df-42ea-9df8-32408a282d42 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:50.312263 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-da175c7d-40df-42ea-9df8-32408a282d42 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:50.312923 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-da175c7d-40df-42ea-9df8-32408a282d42 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:50.313372 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-da175c7d-40df-42ea-9df8-32408a282d42 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:50.313791 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-da175c7d-40df-42ea-9df8-32408a282d42 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:50.446311 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-da175c7d-40df-42ea-9df8-32408a282d42 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:50.454902 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-da175c7d-40df-42ea-9df8-32408a282d42 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1455 microversion: 2.1 time: 0.155138 Aug 10 23:31:50.455479 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 586/1177] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:50 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:31:52.868531 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-2e05ace2-9caa-4dc6-ac22-74ce54cc2407 req-26455758-1308-4b4f-af13-257ded395292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d80ed5-d087-4f53-9d42-549d563abe1e", "tag": "96692853-a89b-49d6-b42c-c2c7b9096980"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:52.874076 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_api:SELECT=39 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:52.880032 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-2e05ace2-9caa-4dc6-ac22-74ce54cc2407 req-26455758-1308-4b4f-af13-257ded395292 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:52.882978 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-2e05ace2-9caa-4dc6-ac22-74ce54cc2407 req-26455758-1308-4b4f-af13-257ded395292 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:52.882978 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-2e05ace2-9caa-4dc6-ac22-74ce54cc2407 req-26455758-1308-4b4f-af13-257ded395292 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:52.893903 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-2e05ace2-9caa-4dc6-ac22-74ce54cc2407 req-26455758-1308-4b4f-af13-257ded395292 service nova] Creating event network-changed:96692853-a89b-49d6-b42c-c2c7b9096980 for instance 48d80ed5-d087-4f53-9d42-549d563abe1e on hv-cinder-85144 Aug 10 23:31:52.899172 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-2e05ace2-9caa-4dc6-ac22-74ce54cc2407 req-26455758-1308-4b4f-af13-257ded395292 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034289 Aug 10 23:31:52.900199 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 592/1178] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:31:53.702299 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:31:53.702554 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Wed Aug 10 23:31:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:32:30.870455 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:32:30.871133 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Wed Aug 10 23:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:33:39.933159 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:33:39.933779 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Wed Aug 10 23:33:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:33:53.712002 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:33:53.712599 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Wed Aug 10 23:33:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:33:53.743474 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43d636a3-c537-412e-803a-ac122d6a7df2] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 23:33:53.744114 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:33:53.745253 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG dbcounter [-] [121333] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:33:53.745399 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11789a10-d90a-4be9-8c9b-c238e9daaec0] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:33:53.746059 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG dbcounter [-] [121332] Writing DB stats nova_cell1:SELECT=7 {{(pid=121332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:33:53.749312 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-cb8c6d4f-4c0b-4fe4-83f6-dbdff35b7f5d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:33:53.749827 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-cb8c6d4f-4c0b-4fe4-83f6-dbdff35b7f5d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:33:53.757534 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb8c6d4f-4c0b-4fe4-83f6-dbdff35b7f5d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:53.758151 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb8c6d4f-4c0b-4fe4-83f6-dbdff35b7f5d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:53.758597 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb8c6d4f-4c0b-4fe4-83f6-dbdff35b7f5d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:53.759497 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb8c6d4f-4c0b-4fe4-83f6-dbdff35b7f5d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:53.759954 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb8c6d4f-4c0b-4fe4-83f6-dbdff35b7f5d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:53.760382 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-cb8c6d4f-4c0b-4fe4-83f6-dbdff35b7f5d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:53.789905 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-cb8c6d4f-4c0b-4fe4-83f6-dbdff35b7f5d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Going to try to terminate instance {{(pid=121333) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:33:53.979074 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-e312193d-7b30-4d4b-9b00-f1dd02bf9faa req-77dc94a8-21fc-4bfe-aabc-9104b593f95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d80ed5-d087-4f53-9d42-549d563abe1e", "tag": "96692853-a89b-49d6-b42c-c2c7b9096980"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:33:53.989878 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-e312193d-7b30-4d4b-9b00-f1dd02bf9faa req-77dc94a8-21fc-4bfe-aabc-9104b593f95f service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:53.990360 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-e312193d-7b30-4d4b-9b00-f1dd02bf9faa req-77dc94a8-21fc-4bfe-aabc-9104b593f95f service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:53.990821 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-e312193d-7b30-4d4b-9b00-f1dd02bf9faa req-77dc94a8-21fc-4bfe-aabc-9104b593f95f service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:54.002037 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-e312193d-7b30-4d4b-9b00-f1dd02bf9faa req-77dc94a8-21fc-4bfe-aabc-9104b593f95f service nova] Creating event network-changed:96692853-a89b-49d6-b42c-c2c7b9096980 for instance 48d80ed5-d087-4f53-9d42-549d563abe1e on hv-cinder-85144 Aug 10 23:33:54.007870 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-e312193d-7b30-4d4b-9b00-f1dd02bf9faa req-77dc94a8-21fc-4bfe-aabc-9104b593f95f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264760 Aug 10 23:33:54.008472 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 593/1179] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:33:54.134200 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-cb8c6d4f-4c0b-4fe4-83f6-dbdff35b7f5d tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "DELETE /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 204 len: 0 microversion: 2.1 time: 0.392890 Aug 10 23:33:54.135369 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 587/1180] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:33:53 2022] DELETE /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:33:54.145248 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-81e36a62-48cd-46b5-99e0-40d04d9d31a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:33:54.146257 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-81e36a62-48cd-46b5-99e0-40d04d9d31a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:33:54.153031 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e36a62-48cd-46b5-99e0-40d04d9d31a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:54.153522 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e36a62-48cd-46b5-99e0-40d04d9d31a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:54.154199 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e36a62-48cd-46b5-99e0-40d04d9d31a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:54.154927 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e36a62-48cd-46b5-99e0-40d04d9d31a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:54.155631 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e36a62-48cd-46b5-99e0-40d04d9d31a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:54.156155 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-81e36a62-48cd-46b5-99e0-40d04d9d31a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:54.426078 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-81e36a62-48cd-46b5-99e0-40d04d9d31a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:33:54.437765 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-81e36a62-48cd-46b5-99e0-40d04d9d31a6 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1580 microversion: 2.1 time: 0.296448 Aug 10 23:33:54.438945 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 594/1181] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:33:54 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1580 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:33:55.468935 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f8740576-e337-4440-affa-a588826d6762 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:33:55.469639 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f8740576-e337-4440-affa-a588826d6762 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:33:55.479201 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8740576-e337-4440-affa-a588826d6762 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:55.479692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8740576-e337-4440-affa-a588826d6762 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:55.480134 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8740576-e337-4440-affa-a588826d6762 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:55.480846 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8740576-e337-4440-affa-a588826d6762 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:55.481306 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8740576-e337-4440-affa-a588826d6762 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:55.481734 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f8740576-e337-4440-affa-a588826d6762 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:55.487247 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO oslo.messaging._drivers.impl_rabbit [-] [43d636a3-c537-412e-803a-ac122d6a7df2] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 34480. Aug 10 23:33:55.671689 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-f8740576-e337-4440-affa-a588826d6762 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:33:55.679373 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f8740576-e337-4440-affa-a588826d6762 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1580 microversion: 2.1 time: 0.215347 Aug 10 23:33:55.679880 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 588/1182] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:33:55 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1580 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:33:56.421376 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-97222a04-8e05-4922-981f-53431fc5dbf9 req-9304d897-10c5-4a90-90bd-c62f23d95c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d80ed5-d087-4f53-9d42-549d563abe1e", "name": "network-vif-deleted", "tag": "96692853-a89b-49d6-b42c-c2c7b9096980"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:33:56.422939 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-97222a04-8e05-4922-981f-53431fc5dbf9 req-9304d897-10c5-4a90-90bd-c62f23d95c45 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:56.423419 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-97222a04-8e05-4922-981f-53431fc5dbf9 req-9304d897-10c5-4a90-90bd-c62f23d95c45 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:56.423846 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-97222a04-8e05-4922-981f-53431fc5dbf9 req-9304d897-10c5-4a90-90bd-c62f23d95c45 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:56.436431 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO oslo.messaging._drivers.impl_rabbit [-] [11789a10-d90a-4be9-8c9b-c238e9daaec0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 34486. Aug 10 23:33:56.438284 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-97222a04-8e05-4922-981f-53431fc5dbf9 req-9304d897-10c5-4a90-90bd-c62f23d95c45 service nova] Creating event network-vif-deleted:96692853-a89b-49d6-b42c-c2c7b9096980 for instance 48d80ed5-d087-4f53-9d42-549d563abe1e on hv-cinder-85144 Aug 10 23:33:56.443651 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-97222a04-8e05-4922-981f-53431fc5dbf9 req-9304d897-10c5-4a90-90bd-c62f23d95c45 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035167 Aug 10 23:33:56.444240 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 595/1183] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:33:56.700690 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2401288e-42de-433d-987d-9685a9ca4bef tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:33:56.701308 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2401288e-42de-433d-987d-9685a9ca4bef tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:33:56.707985 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2401288e-42de-433d-987d-9685a9ca4bef tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:56.708476 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2401288e-42de-433d-987d-9685a9ca4bef tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:56.708920 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2401288e-42de-433d-987d-9685a9ca4bef tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:56.709645 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2401288e-42de-433d-987d-9685a9ca4bef tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:56.710144 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2401288e-42de-433d-987d-9685a9ca4bef tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:56.710612 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2401288e-42de-433d-987d-9685a9ca4bef tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:56.775749 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.policy [None req-2401288e-42de-433d-987d-9685a9ca4bef tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121333) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:33:56.788175 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2401288e-42de-433d-987d-9685a9ca4bef tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 200 len: 1226 microversion: 2.1 time: 0.091310 Aug 10 23:33:56.789503 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 589/1184] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:33:56 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:33:57.816423 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:33:57.817125 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 48d80ed5-d087-4f53-9d42-549d563abe1e] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:33:57.823823 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:57.824304 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:57.824740 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:57.825473 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:33:57.825924 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:33:57.826347 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:33:57.839951 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] HTTP exception thrown: Instance 48d80ed5-d087-4f53-9d42-549d563abe1e could not be found. Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Request method failure captured: Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e HTTP/1.1 Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D5IxOStWrckVjfeZ-c9oxhRh3RI7Kvmftyu7o7MapUqG7-kmsXHZGriQpAgwl1MxRQKh9QWRC8pn-mPSGyKFb5MSFoHwrAEzEa5ePdF9mtfK678GTght-HLruzPttDqBm-6Wk7erd9Fsfs76YPNqQ19NCNlWXaWAyPhVdcn28fYrPA Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 8d2bfa865669477f8757e977da29420a Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-TestVolumeBootPattern-704763467 Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:33:57.841580 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d2bfa865669477f8757e977da29420a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d2bfa865669477f8757e977da29420a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8d2bfa865669477f8757e977da29420a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8d2bfa865669477f8757e977da29420a", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-TestVolumeBootPattern-704763467 Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 8d2bfa865669477f8757e977da29420a Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-TestVolumeBootPattern-704763467 Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-TestVolumeBootPattern-704763467-project Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 05e18a4fd73e435aa6d0f10a37405698 Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-TestVolumeBootPattern-704763467-project Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance 48d80ed5-d087-4f53-9d42-549d563abe1e could not be found. Aug 10 23:33:57.843468 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': '48d80ed5-d087-4f53-9d42-549d563abe1e'} Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d80ed5-d087-4f53-9d42-549d563abe1e could not be found. Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:33:57.844476 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d80ed5-d087-4f53-9d42-549d563abe1e could not be found. Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d80ed5-d087-4f53-9d42-549d563abe1e could not be found. Aug 10 23:33:57.845970 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:33:57.847380 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Returning 404 to user: Instance 48d80ed5-d087-4f53-9d42-549d563abe1e could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:33:57.847380 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-138f0363-25aa-4128-86fd-69b456fcbd11 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e" status: 404 len: 111 microversion: 2.1 time: 0.031229 Aug 10 23:33:57.847380 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 596/1185] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:33:57 2022] GET /compute/v2.1/servers/48d80ed5-d087-4f53-9d42-549d563abe1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:34:01.106535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-f03d3c7c-b44d-4d04-a544-b874181746ab tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:01.107266 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f03d3c7c-b44d-4d04-a544-b874181746ab tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:01.108404 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [req-57b6a0f6-8cba-431d-b6e7-3e0b9578225f req-64e1629a-1a57-43cd-9863-def31f63fe96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c344d4-3cad-4938-8631-f0320f44d333", "tag": "bbe68c6c-c2d2-4ac4-9443-f6a999af222f"}]} {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:34:01.114280 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f03d3c7c-b44d-4d04-a544-b874181746ab tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:01.114901 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f03d3c7c-b44d-4d04-a544-b874181746ab tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:01.115410 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f03d3c7c-b44d-4d04-a544-b874181746ab tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:01.116202 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f03d3c7c-b44d-4d04-a544-b874181746ab tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:01.116790 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f03d3c7c-b44d-4d04-a544-b874181746ab tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:01.117288 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-f03d3c7c-b44d-4d04-a544-b874181746ab tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:01.118852 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-57b6a0f6-8cba-431d-b6e7-3e0b9578225f req-64e1629a-1a57-43cd-9863-def31f63fe96 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:01.119283 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-57b6a0f6-8cba-431d-b6e7-3e0b9578225f req-64e1629a-1a57-43cd-9863-def31f63fe96 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:01.119711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [req-57b6a0f6-8cba-431d-b6e7-3e0b9578225f req-64e1629a-1a57-43cd-9863-def31f63fe96 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:01.131711 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.compute.server_external_events [req-57b6a0f6-8cba-431d-b6e7-3e0b9578225f req-64e1629a-1a57-43cd-9863-def31f63fe96 service nova] Creating event network-changed:bbe68c6c-c2d2-4ac4-9443-f6a999af222f for instance 47c344d4-3cad-4938-8631-f0320f44d333 on hv-cinder-85144 Aug 10 23:34:01.139895 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [req-57b6a0f6-8cba-431d-b6e7-3e0b9578225f req-64e1629a-1a57-43cd-9863-def31f63fe96 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034390 Aug 10 23:34:01.140495 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 597/1186] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:34:01.149495 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-f03d3c7c-b44d-4d04-a544-b874181746ab tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Going to try to terminate instance {{(pid=121333) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:34:01.493607 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-f03d3c7c-b44d-4d04-a544-b874181746ab tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "DELETE /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 204 len: 0 microversion: 2.1 time: 0.391076 Aug 10 23:34:01.494483 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 590/1187] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:34:01 2022] DELETE /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:34:01.503197 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-2458f89a-1787-4650-8f3a-be87f1685f2e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:01.504286 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-2458f89a-1787-4650-8f3a-be87f1685f2e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:01.510680 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2458f89a-1787-4650-8f3a-be87f1685f2e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:01.511200 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2458f89a-1787-4650-8f3a-be87f1685f2e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:01.511691 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2458f89a-1787-4650-8f3a-be87f1685f2e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:01.512406 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2458f89a-1787-4650-8f3a-be87f1685f2e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:01.512887 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2458f89a-1787-4650-8f3a-be87f1685f2e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:01.513299 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-2458f89a-1787-4650-8f3a-be87f1685f2e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:01.726396 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-2458f89a-1787-4650-8f3a-be87f1685f2e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:01.735193 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-2458f89a-1787-4650-8f3a-be87f1685f2e tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1580 microversion: 2.1 time: 0.236373 Aug 10 23:34:01.736692 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 598/1188] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:01 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1580 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:34:02.740624 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [req-edccd294-cbb9-4757-b2c9-e3bb56954726 req-3f05601d-8e7b-4168-b338-0efe63d26769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c344d4-3cad-4938-8631-f0320f44d333", "name": "network-vif-deleted", "tag": "bbe68c6c-c2d2-4ac4-9443-f6a999af222f"}]} {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:34:02.750567 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-edccd294-cbb9-4757-b2c9-e3bb56954726 req-3f05601d-8e7b-4168-b338-0efe63d26769 service nova] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:02.751169 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-edccd294-cbb9-4757-b2c9-e3bb56954726 req-3f05601d-8e7b-4168-b338-0efe63d26769 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:02.751607 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [req-edccd294-cbb9-4757-b2c9-e3bb56954726 req-3f05601d-8e7b-4168-b338-0efe63d26769 service nova] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:02.756761 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-55ca32bc-0955-4b04-8fc9-956a0b00c547 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:02.757327 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-55ca32bc-0955-4b04-8fc9-956a0b00c547 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:02.763542 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.compute.server_external_events [req-edccd294-cbb9-4757-b2c9-e3bb56954726 req-3f05601d-8e7b-4168-b338-0efe63d26769 service nova] Creating event network-vif-deleted:bbe68c6c-c2d2-4ac4-9443-f6a999af222f for instance 47c344d4-3cad-4938-8631-f0320f44d333 on hv-cinder-85144 Aug 10 23:34:02.763880 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-55ca32bc-0955-4b04-8fc9-956a0b00c547 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:02.764403 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-55ca32bc-0955-4b04-8fc9-956a0b00c547 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:02.765075 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-55ca32bc-0955-4b04-8fc9-956a0b00c547 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:02.765787 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-55ca32bc-0955-4b04-8fc9-956a0b00c547 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:02.766253 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-55ca32bc-0955-4b04-8fc9-956a0b00c547 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:02.767341 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-55ca32bc-0955-4b04-8fc9-956a0b00c547 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:02.768470 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [req-edccd294-cbb9-4757-b2c9-e3bb56954726 req-3f05601d-8e7b-4168-b338-0efe63d26769 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032625 Aug 10 23:34:02.769084 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 591/1189] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 10 23:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:34:02.832889 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.policy [None req-55ca32bc-0955-4b04-8fc9-956a0b00c547 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e18a4fd73e435aa6d0f10a37405698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2bfa865669477f8757e977da29420a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:02.840639 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-55ca32bc-0955-4b04-8fc9-956a0b00c547 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 200 len: 1393 microversion: 2.1 time: 0.088234 Aug 10 23:34:02.841202 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 599/1190] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:02 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 1393 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:34:03.863360 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:03.865194 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: 47c344d4-3cad-4938-8631-f0320f44d333] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:03.871397 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:03.871884 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:03.872327 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:03.873031 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:03.873490 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:03.873919 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:03.887873 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] HTTP exception thrown: Instance 47c344d4-3cad-4938-8631-f0320f44d333 could not be found. Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Request method failure captured: Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 HTTP/1.1 Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D5IxOStWrckVjfeZ-c9oxhRh3RI7Kvmftyu7o7MapUqG7-kmsXHZGriQpAgwl1MxRQKh9QWRC8pn-mPSGyKFb5MSFoHwrAEzEa5ePdF9mtfK678GTght-HLruzPttDqBm-6Wk7erd9Fsfs76YPNqQ19NCNlWXaWAyPhVdcn28fYrPA Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 8d2bfa865669477f8757e977da29420a Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-TestVolumeBootPattern-704763467 Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:34:03.891726 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d2bfa865669477f8757e977da29420a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d2bfa865669477f8757e977da29420a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8d2bfa865669477f8757e977da29420a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8d2bfa865669477f8757e977da29420a", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-TestVolumeBootPattern-704763467 Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 8d2bfa865669477f8757e977da29420a Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-TestVolumeBootPattern-704763467 Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-TestVolumeBootPattern-704763467-project Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 05e18a4fd73e435aa6d0f10a37405698 Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-TestVolumeBootPattern-704763467-project Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance 47c344d4-3cad-4938-8631-f0320f44d333 could not be found. Aug 10 23:34:03.893595 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': '47c344d4-3cad-4938-8631-f0320f44d333'} Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c344d4-3cad-4938-8631-f0320f44d333 could not be found. Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:34:03.894634 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c344d4-3cad-4938-8631-f0320f44d333 could not be found. Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c344d4-3cad-4938-8631-f0320f44d333 could not be found. Aug 10 23:34:03.896346 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:34:03.898457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Returning 404 to user: Instance 47c344d4-3cad-4938-8631-f0320f44d333 could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:34:03.898457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-2ffce36e-e3e3-4d1f-a029-78ccd2de1e4b tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333" status: 404 len: 111 microversion: 2.1 time: 0.032465 Aug 10 23:34:03.898457 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 592/1191] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:03 2022] GET /compute/v2.1/servers/47c344d4-3cad-4938-8631-f0320f44d333 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:34:04.410453 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:04.411737 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.compute.api [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:04.418324 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:04.418923 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:04.419367 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:04.420076 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:04.420537 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:04.420964 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG oslo_concurrency.lockutils [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:04.435155 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.wsgi [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] HTTP exception thrown: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Request method failure captured: Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: request: DELETE /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c HTTP/1.1 Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept: application/json Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Accept-Encoding: identity Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Connection: close Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Length: 0 Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Content-Type: application/json Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Host: 10.222.0.78 Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Openstack-System-Scope: None Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: User-Agent: python-urllib3/1.26.11 Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Auth-Token: gAAAAABi9D5IxOStWrckVjfeZ-c9oxhRh3RI7Kvmftyu7o7MapUqG7-kmsXHZGriQpAgwl1MxRQKh9QWRC8pn-mPSGyKFb5MSFoHwrAEzEa5ePdF9mtfK678GTght-HLruzPttDqBm-6Wk7erd9Fsfs76YPNqQ19NCNlWXaWAyPhVdcn28fYrPA Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Id: None Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Domain-Name: None Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Identity-Status: Confirmed Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Is-Admin-Project: True Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Id: default Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Domain-Name: Default Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Id: 8d2bfa865669477f8757e977da29420a Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Project-Name: tempest-TestVolumeBootPattern-704763467 Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Role: reader,member Aug 10 23:34:04.436836 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Roles: reader,member Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d2bfa865669477f8757e977da29420a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d2bfa865669477f8757e977da29420a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8d2bfa865669477f8757e977da29420a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8d2bfa865669477f8757e977da29420a", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant: tempest-TestVolumeBootPattern-704763467 Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Id: 8d2bfa865669477f8757e977da29420a Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-Tenant-Name: tempest-TestVolumeBootPattern-704763467 Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User: tempest-TestVolumeBootPattern-704763467-project Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Id: default Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Domain-Name: Default Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Id: 05e18a4fd73e435aa6d0f10a37405698 Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: X-User-Name: tempest-TestVolumeBootPattern-704763467-project Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: method: > Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: exception: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:34:04.438436 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: action_args: {'id': 'b873b552-1351-4f68-88f2-08fc66c4e21c'} Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:34:04.439369 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:34:04.441590 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: ERROR nova.api.openstack.wsgi Aug 10 23:34:04.443592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Returning 404 to user: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. {{(pid=121332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:34:04.443592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-4e0e005d-978c-483c-ab1f-c3eb8cbdfc2c tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 404 len: 111 microversion: 2.1 time: 0.031917 Aug 10 23:34:04.443592 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 600/1192] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 10 23:34:04 2022] DELETE /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:34:04.447398 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '>' {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:04.448023 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.compute.api [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] [instance: b873b552-1351-4f68-88f2-08fc66c4e21c] Fetching instance by UUID {{(pid=121333) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:04.454001 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:04.454489 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:04.454968 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:04.455665 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Acquiring lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:04.456125 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:04.456557 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG oslo_concurrency.lockutils [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Lock "62cffb2b-b617-4f0b-acb7-5b1c401f61ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:04.470133 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.wsgi [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] HTTP exception thrown: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Request method failure captured: Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: request: GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c HTTP/1.1 Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept: application/json Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Accept-Encoding: identity Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Connection: close Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Length: 0 Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Content-Type: application/json Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Host: 10.222.0.78 Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Openstack-System-Scope: None Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: User-Agent: python-urllib3/1.26.11 Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Auth-Token: gAAAAABi9D5IxOStWrckVjfeZ-c9oxhRh3RI7Kvmftyu7o7MapUqG7-kmsXHZGriQpAgwl1MxRQKh9QWRC8pn-mPSGyKFb5MSFoHwrAEzEa5ePdF9mtfK678GTght-HLruzPttDqBm-6Wk7erd9Fsfs76YPNqQ19NCNlWXaWAyPhVdcn28fYrPA Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Id: None Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Domain-Name: None Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Identity-Status: Confirmed Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Is-Admin-Project: True Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Id: default Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Domain-Name: Default Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Id: 8d2bfa865669477f8757e977da29420a Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Project-Name: tempest-TestVolumeBootPattern-704763467 Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Role: reader,member Aug 10 23:34:04.471693 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Roles: reader,member Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d2bfa865669477f8757e977da29420a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d2bfa865669477f8757e977da29420a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8d2bfa865669477f8757e977da29420a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8d2bfa865669477f8757e977da29420a", "adminURL": "http://10.222.0.78:8080"}]}] Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant: tempest-TestVolumeBootPattern-704763467 Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Id: 8d2bfa865669477f8757e977da29420a Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-Tenant-Name: tempest-TestVolumeBootPattern-704763467 Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User: tempest-TestVolumeBootPattern-704763467-project Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Id: default Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Domain-Name: Default Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Id: 05e18a4fd73e435aa6d0f10a37405698 Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: X-User-Name: tempest-TestVolumeBootPattern-704763467-project Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: method: > Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: exception: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:34:04.474127 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: action_args: {'id': 'b873b552-1351-4f68-88f2-08fc66c4e21c'} Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: {{(pid=121333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:34:04.475163 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. Aug 10 23:34:04.476999 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: ERROR nova.api.openstack.wsgi Aug 10 23:34:04.478692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: DEBUG nova.api.openstack.wsgi [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Returning 404 to user: Instance b873b552-1351-4f68-88f2-08fc66c4e21c could not be found. {{(pid=121333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:34:04.478692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO nova.api.openstack.requestlog [None req-749a9cc8-2d27-41e7-9b8a-d18696f19d2f tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c" status: 404 len: 111 microversion: 2.1 time: 0.029671 Aug 10 23:34:04.478692 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: [pid: 121333|app: 0|req: 593/1193] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:04 2022] GET /compute/v2.1/servers/b873b552-1351-4f68-88f2-08fc66c4e21c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:34:05.913839 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: DEBUG nova.api.openstack.wsgi [None req-727adec1-c072-4930-8799-4f0643368881 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] Calling method '.version_select at 0x7fe840118280>' {{(pid=121332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:05.996521 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO nova.api.openstack.requestlog [None req-727adec1-c072-4930-8799-4f0643368881 tempest-TestVolumeBootPattern-704763467 tempest-TestVolumeBootPattern-704763467-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1887301686" status: 202 len: 0 microversion: 2.1 time: 0.086450 Aug 10 23:34:05.997132 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: [pid: 121332|app: 0|req: 601/1194] 10.222.0.78 () {58 vars in 1263 bytes} [Wed Aug 10 23:34:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1887301686 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:35:50.880238 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:35:50.880886 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Wed Aug 10 23:35:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:36:53.714811 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:36:53.715401 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Wed Aug 10 23:36:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:36:56.045143 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:36:56.045775 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Wed Aug 10 23:36:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:36:59.942024 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:36:59.942612 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Wed Aug 10 23:36:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:37:13.720969 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:37:13.721535 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Wed Aug 10 23:37:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:37:15.203820 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:37:15.204422 dv-cinder-851449-5-iscsi devstack@n-api.service[121332]: Wed Aug 10 23:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:39:10.888911 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:39:10.889571 dv-cinder-851449-5-iscsi devstack@n-api.service[121333]: Wed Aug 10 23:39:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!